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This  research  effort  in  the  field  of  software  reliability  is  primarily  based 
on  probability:  as  applied  to  error  detection  rates;  as  applied  to  the  gen- 
eration of  input  test  data;  and  as  applied  to  the  economics  of  random  versus 
constructed  test  cases.  The  background  description  of  the  flow  of  computa- 
tions is  made  by  means  of  a directed  graph  representation  and  a connection 
matrix  depicting  possible  links  between  program  segments.  Random  number 
selected  from  a given  domain  by  several  distributions  are  employed  as  input 
to  programs  instrumented  to  detect  the  use  of  the  program's  segments.  An 
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<10.  Abstract  (Continued) 


algorithm  is  employed  to  estimate  the  total  number  of  execution  sequences 
which  are  likely  to  be  eventually  driven  by  random  number  inputs,  and,  by 
implication,  the  point  in  testing  where  the  change  to  constructed  cases 
should  be  made.  Models  for  determining  the  count  of  these  execution 
sequences  are  described  and  tables  which  facilitate  estimation  of  the  number 
of  logical  paths  and  related  parameters  are  provided  for  convenience. 


PREFACE 

This  report  documents  the  results  obtained  under  contract  F44620-74-C-0008 
entitled  "Quantitative  Methods  for  Software  Reliability  Measurements", 
during  the  36  month  period  ending  in  November  1976.  This  work  was  conducted 
in  the  Information  Systems  Sciences  Branch,  of  the  Data  Control  and 
Processing  Subsystems  Department,  McDonnell  Douglas  Astronautics  Company-West, 
in  Huntinqton  Beach,  California.  Excepting  the  Appendix  I,  this  report 
was  written  by  Paul  B.  Moranda,  Information  Systems  Advisor  Senior  and 
Principal  Investigator,  under  the  direction  of  Zygmunt  Jel inski,  Program 
Manager.  The  assistance  of  Mrs.  Carolyn  Boettcher  of  McDonnell  Douglas 
Automation  Company,  in  performing  several  special  numerical  analyses  and  in 
writing  the  supporting  computer  programs  for  the  study,  is  gratefully 
acknowledged.  This  work  was  conducted  under  the  auspices  of  the  Air  Force 
Office  of  Scientific  Research  and  was  monitored  by  Lt.  Col.  Thomas  Wachowski 
and  Lt.  Col.  George  W.  McKemie  whose  assistance,  both  direct  and  indirect, 
are  also  gratefully  acknowledged. 


ABSTRACT 


V 

This  research  effort  in  the  field  of  software  reliability  is  primarily  based 
on  probability:  as  applied  to  error  detection  rates;  as  applied  to  the  gen- 

eration of  input  test  data;  and  as  applied  to  the  economics  of  random  versus 
constructed  test  cases.  The  background  description  of  the  flow  of  computa- 
tions is  made  by  means  of  a directed  graph  representation  and  a connection 
matrix  depicting  possible  links  between  program  segments.  Random  numbers 
selected  from  a given  domain  by  several  distributions  are  employed  as  Input 
to  programs  Instrumented  to  detect  the  use  of  the  program's  segments.  An 
algorithm  is  employed  to  estimate  the  total  number  of  execution  sequences 
which  are  likely  to  be  eventually  driven  by  random  number  inputs,  and,  by 
implication,  the  point  in  testing  where  the  change  to  constructed  cases 
should  be  made.  Models  for  determining  the  count  of  these  execution  sequences 
are  described  and  tables  which  facilitate  estimation  of  the  number  of  logical 
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INTRODUCTION  AND  OVERVIEW 


A.  Introduction 

A reasonable  categorization  of  the  broad  study  of  software  reliability  corr- 
esponds in  many  respects,  to  one  of  the  commonly  employed  categorizations 
of  the  phases  of  development  which  software  packages  undergo.  Corresponding 
to  the  design  phase  of  software  development,  there  is  an  aspect  of  the 
reliability  problem  dealing  with  estimation  of  the  error  content  before 
(a  priori)  any  actual  running  of  the  program  has  taken  place.  The  test 
phase  of  software  development  can  be  associated  with  reliability  estimates 
which  are  determined  during  relatively  exhaustive  testing  by  measures  of  the 
internal  operations  of  single  modules;  some  measure  of  the  complexity  of 
the  package  and  of  the  response  to  randomly  chosen  inputs  are  useful  in 
developing  reliability  estimates.  The  third  phase  of  software  development 
can  go  under  the  name  of  user-phase;  this  phase  would  include  any  signifi- 
cant testing  of  sets  of  modules  (ordinarily  this  makes  up  part  of  what 
is  called  integration);  this  phase  would  employ  the  time  record  of  the 
occurrences  of  errors,  for  the  primary  data  for  system  level  reliability 
estimation. 

Data  relating  to  the  third  category  was  the  object  of  study  by  MDAC  during 
the  period  prior  to  the  contract  interval  (1971-1973)  and  as  a result  of 
this  effort,  the  first  parametric  model  for  the  software  debugging  process  was 
developed  and  reported  in  the  literature  (Reference  1).  This  model  required 
no  knowledge  of  the  actual  coding,  the  flow  charting,  or  the  mode  of  operation, 
and,  indeed,  treated  the  software  package  as  a "blackbox". 

The  first  category,  that  of  developing  a priori  estimates,  vis  a vis  the  a 
posteriori  estimates  of  the  previous  work,  was  the  principal  subject  of 
the  work  performed  during  the  first  year  of  the  contract.  In  order  to 
develop  estimates  of  that  type  it  was  necessary  to  "look  inside  the  box," 
and  to  develop  efficient  means  of  describing  the  information.  The  resultant 
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study  resulted  in  a directed  graph/connection  matrix  representation  for  the 
static  and  dynamic  analyses  of  the  test  programs. 


Input  test  cases,  formed 
to  drive  the  programs  in 


by  means  of  random  number 
different  ways. 


generators,  were  employed 


As  an  outgrowth  of  this  research,  particularly  that  which  developed  the  frame- 
work for  computation  of  a priori  or  "operational"  software  reliability 
estimates,  a need  for  deeper  investigations  into  test  case  selection  was 
noted  and  redirection  in  that  area  was  carried  out  during  the  second  phase. 


As  an  aid  to  determining  the  point  in  testing  where  a change  should  be  made 
from  tests  based  on  random  number  inputs,  to  tests  constructed  on  the  basis 
of  the  code  itself,  an  algorithm  was  developed  which  permits  evaluation  of 
the  "yield"  which  can  be  gained  by  additional  testing. 


B.  Objectives  and  Task  Descriptions 

The  original  plan  for  the  research  redirected  in  ways  subsequently  described, 
was  given  in  terms  of  three  tasks  of  the  first  (of  three)  phase(s): 


Task  I - to  investigate  the  existence  of  relations  between  the 
number  and  range  of  input  variables  and  software  reliability,  and 
to  establish  a relationship  between  the  gross  measures  (such  as 
program  size,  number  of  branching  statements)  of  a software  package 
and  its  reliability.  A program  testing  translator  will  be  used  as 
a tool  to  analyze  frequency  of  execution  of  branches  and  instructions. 

Task  II  - to  develop  an  algorithm  representing  relationships  between 
variables  and  the  software  reliability  - extrapolation  techniques 
will  be  developed  which  will  relate  the  counts  obtained  over  a given 
collection  of  subsets  or  samples  to  the  counts  which  would  be 
obtained  over  larger  sets. 

Task  III  - to  generalize  the  above  algorithm.  This  algorithm  will  be 
tested  on  a representative  sample  of  FORTRAN  programs  and  adjusted 
accordingly. 
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C.  Course  of  the  Research  Program 

First,  it  is  well  to  note  that,  with  respect  to  the  problem  of  relating  re- 
liability to  measures  of  the  internal  parameters  of  a program,  that  two  separate 
studies  by  other  groups,  (one  by  TRW,  Reference  [2]  and  one  by  Lulejian  and 
Associates,  Reference  [3] .concluded  that  out  of  22  quantitative  measures  of 
programs  (and  their  programmers ) there  was  only  one  case  which  showed  a 
significant  correlation.  This  significant  correlation  was  between  reliability 
and  program  size.  Only  the  contrary  would  be  surprising  - more  opportunities 
for  errors  should  be  accompanied  by  more  errors.  These  studies  employed 
relatively  large  real  time  programs  (command  and  control)  and  as  such  they 
dealt  with  programs  which  are  quite  relevant  to  this  study.  Because  of  the 
essentially  negative  results  which  were  obtained,  there  seemed  to  be  little 
use  in  pursuing  similar  lines  in  our  investigation. 

The  initial  work  focused  on  the  instrumentation  (insertion  of  monitoring 
instructions)  of  programs  so  that  their  dynamic  (performance)  rather  than 
their  static  (structured)  aspects  could  be  examined.  The  investigation  of 
the  dynamic  or  operational  characteristics  turned  out  to  be  important:  in 

the  final  analysis  it  is  relatively  unimportant  how  complex  a program  appears 
to  be,  it  matters  more  what  the  program  actually  does.  The  instrumentation 
was  accomplished  by  use  of  a MOAC -developed  software  tool  called  the  Program 
Testing  Translator  (PTT).  This  tool  described  in  some  detail  in  Section 
of  this  report  (and  in  complete  detail  by  L.  Stucki  in  Reference  (4)),  pro- 
vides the  user  with  a means  of  establishing  the  usage  of  each  instruction 
and  each  branch  of  predicates  of  FORTRAN  programs.  In  addition,  the  range 
of  values  which  the  program  variables  take  as  a result  of  a particular  value 
of  the  input  variable  (which  can  be  considered  to  be  a vector,  since  in 
most  programs  several  input  variables  are  employed)  was  recorded  for  each 
segment  containing  an  assignment  instruction,  the  equivalent  of  a program 
function. 

Any  particular  point  of  the  input  data  set,  more  commonly  called  the  domain 
of  the  input  variable,  will  cause  the  associated  program  to  sequence  Its 
instructions  in  a particular  way.  When  the  program  has  been  Instrumented 
with  the  Program  Testing  Translator,  data  relating  to  the  path  of  computation 
and  values  achieved  by  computed  variables  can  be  composed.  An  augmentation 
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of  the  PTT  permits  automatic  generation  of  program  segments  and  this  materially 
aided  the  analysis. 

After  the  initial  experiments  were  made  with  random  numbers  with  two  programs, 
there  were  several  factors  which  led  the  investigation  to  open  up  new  avenues 
of  research.  In  the  first  place,  a review  of  the  International  Mathematical 
Subroutine  Library  (IMSL),  which  had  been  selected  as  the  set  of  programs  for 
the  investigation,  revealed  that  most  of  the  inputs  to  these  programs  cannot 
realistically  be  assumed  to  be  governed  by  probability  laws;  the  degree  of  a 
polynomial  and  the  order  of  a matrix  are  not  random  for  example,  and  even 
when  the  variables  can  be  considered  random,  such  as  the  coefficients  in  a 
polynomial  root  locator,  the  law  which  fits  the  sampling  of  these  numbers 
(by  the  universe  of  all  users)  will  not  be  known.  The  alternative  of  analyzing 
real-time  programs  requires  special  knowledge  of  special  languages  and  special 
machines  and  so  requires  a number  of  highly  skilled  programmers. 


In  addition,  the  measurement  of  reliability  of  a program  in  the  sense  used  in 
the  task  description,  depends  on  data  which,  it  was  assumed  would  be  recorded 
either  by  the  users  of  the  routines  of  the  library  (it  was  assumed  they  would 
record  anomalies  as  they  were  discovered),  or,  alternatively,  by  a single  user 
or  small  set  of  users,  who  could  pervasively  test  the  programs  by  means  of 
random  number  generators  and  special  tests  until  a significant  set  of  errors 
were  discovered.  Neither  of  these  turn  out  to  be  practical  alternatives. 


On  the  one  hand,  the  subroutines  from  the  software  library  which  are  used, 
are  generally  in  linkage  with  others,  and  the  "input"  data  to  the  routine 
usually  is  totally  transparent  to  the  programmer,  it  comes  as  a result  of 
prior  computations.  Of  course,  it  is  possible  to  gain  snapshots  of  this 
inputs,  but  the  price  is  considerable  coding  time  by  systems-level  programmers; 
it  is  unlikely  that  this  overhead  can  be  justified. 


On  the  other  side,  it  becomes  apparent.with  experience,  that  the  input  per  se 
is  less  a determinant  of  the  degree  of  testing  than  such  things  as  the 
structure  of  the  program  or  the  amount  of  protection  inserted  to  guard 
against  certain,  perhaps  rarely  occurring,  events.  Furthermore,  it  is 
likely  that  a user  who  did  not  participate  in  the  design  of  the  program 
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will  be  essentially  naive  with  respect  to  the  occurrence  of  an  actual  error 
and  with  respect  to  the  location  of  the  "sensitive"  portions  to  test  with 
well -chosen  input  data. 

Because  of  the  factors  cited  above,  a fresh  approach  was  taken;  one  which,  to 
begin  with,  was  essentially  exploratory.  The  major  aim  in  this  approach  was 
to  develop  an  a priori  measure  of  reliability  using  input  data  which  is 
assumed  to  be  randomly  chosen  by  a known  law  or  set  of  laws,  and  the  length 
and  connectivity  of  the  segments  (the  programs  building  blocks)  which  the  random 
data  drive.  An  important  feature  of  this  type  of  testing  is  that  the  dynamic 
(performance)  rather  than  the  static  (structural)  aspects  are  emphasized. 

It  is  important  also  to  note  that  the  output  of  the  program  is  not  examined 
critically  and  consequently  most  software  errors  which  do  occur  will  not 
ordinarily  be  detected.  The  a priori  reliability  is  developed  on  the  basis 
of  the  way  the  program  is  used  and  a "universal"  a priori  probability  for 
the  rate  of  occurrence  of  coding  errors. 

This  type  of  measure  would  be  valuable  in  some  real  time  programs  which  depend 
on  sensor  measurements  for  some  or  all  of  its  data.  Gyroscopes,  telescopes, 
accelerometers,  and  their  pickoffs,  resolvers,  and  similar  devices  all  have 
random  components  in  their  associated  measurements;  furthermore,  the  systematic 
portion  of  the  measurement  in  many  cases  may  be  considered  in  a larger  sense 
as  having  a probability  law  governing  their  choice  - initial  vector  heading 
at  alignment  time  might,  for  example,  be  any  value  (uniformly)  on  the  circle. 

As  this  study  developed,  it  became  clear  that  the  use  of  random  numbers  as 
input  can  serve  very  well  toward  achieving  comprehensive  testing  of  almost 
any  program.  This  investigation  then  picked  up  earlier  work,  started  during 
the  exploratory  phase,  and  simple  measures  of  the  degree  to  which  random 
numbers  can  test  a program  were  developed.  Following  this,  there  was  an 
attempt  made  to  give  a quantitative  measure  to  the  eventual  level  of  testing 
which  could  be  achieved  by  random  number  inputs.  This  resulted  In  an 
algorithm  which  was  even  more  useful  than  the  one  which  was  sought:  it 

provided  an  estimate  of  the  total  number  of  execution  sequences  (realizable 
logical  paths)  which  can  be  achieved  by  random  testing.  The  application 
of  this  algorithm  on  two  programs  produced  results  which  were  surprising 
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in  the  respect  that  the  numbers  produced  were  orders  of  magnitude  smaller 
than  those  propounded  by  the  "conventional  myth".  Further,  the  results 
were  consistent  in  the  sense  that  application  of  the  algorithm  to  a portion, 
an  initial  segment,  of  data  produced  estimates  which  the  later  realization 
tended  to  support. 

D.  Publications  and  Presentations 

The  following  papers  which  were  sponsored  entirely,  or  in  part,  by  the  contract 
are  listed  below.  In  most  cases  these  were  personally  presented  to  a 
professional  audience  and  published  in  proceddings  of  the  respective  meetings. 


1.  "Predictions  of  Software  Reliability  During  Debugging",  1975 
Proc.  Annual  Reliability  and  Maintainability  Symposium,  Washington, 
D.C. , January  1975. 

2.  "Estimation  of  A-Priori  Software  Reliability",  Proceedings  of 
Computer  Science  and  Statistics:  8th  Annual  Symposium  on  the 
Interface,  Los  Angeles,  February  1975. 

3.  "Software  Reliability  Predictions",  International  Federation 

of  Automatic  Control  6th  World  Triennial  Congress,  Boston/Cambridge, 
August,  1975. 

4.  "Probability-Based  Models  for  the  Failures  During  Burn-In", 

Joint  National  Meeting  ORSA/TIMS,  Las  Vegas,  November  1975. 

5.  "A  Comparison  of  Software  Error  Rate  Models",  Fourth  Texas 
Conference  on  Computing  Systems,  Austin,  Texas,  November  1975. 

6.  "A  Failure  Rate  Model  for  Burn-In  through  Steady  State",  Joint 
National  Meeting  of  ORSA/TIMS,  Philadelphia,  March  1976. 

In  addition,  the  manuscript  for  a book  to  be  published  by  Academic  Press 
has  been  prepared  and  is  In  the  preliminary  stages.  This  book,  "Probability- 
Based  Models  for  Software  Reliability  Analysis",  authored  by  P.  Moranda 
and  Z.  Jelinski,  contains  much  material  developed  under  the  AFOSR  contract 
and  described  herein.  It  is  not  current  in  the  respect  that  several  new 
and  significant  results  produced  under  the  contract  are  not  Included. 
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II.  PRELIMINARY  TECHNICAL  DISCUSSION 


A.  Framework  of  Representation 

In  the  customary  renditions  of  program  flowcharts,  each  (rectangular)  block 
represents  either  a simple  instruction,  or  a group  of  operations,  with  a 
single  output,  while  each  diamond  represents  a single  explicit  or  implied 
predicate  which  has  two  or  more  output  options.  Connecting  the  blocks  and 
diamonds  of  a flowchart,  are  directed  lines  denoted,  and  referred  to,  as 
arrows.  These  lines  represent  the  options  possible  and  are  called  flow-of- 
control  arrows.  These  fundamental  building  blocks  are  adequate  for  the 
static  or  structural  description  of  a program,  but  are  not  convenient  for 
representing  its  operational  aspects.  The  basic  operations  are  better  defined 
in  terms  of  some  simple  program  components.  These  lend  themselves  to 
mathematical  descriptions  and  they  motivate  the  choice  for  the  "atomic"  or 
fundamental  unit  of  description. 

First,  it  is  noted  that  an  instruction  in  a program,  while  easy  to  define 
(statically)  in  "machine  language",  becomes  rather  difficult  in  most  of  the 
higher  order  languages.  Thus  a "clear  and  add"  instruction,  in  machine 
language,  causes  a register  (accumulator)  to  be  set  to  zero  and  another 
register  to  be  transferred  to  the  cleared  register  and  nothing  more. 

Once  the  final  bit  Is  transferred,  the  machine  waits  until  the  next  instruction, 
which  Is  generally  started  by  a timing  or  clock  pulse.  On  the  other  hand, 
the  concept  of  an  instruction  In  the  higher  languages  is  less  clear.  An 
"Instruction"  In  ALGOL,  for  example,  is  either  a statement  or  a declaration, 
and  In  either  case  is  used  to  indicate  required  compiler  (as  against  computer) 
actions.  As  a result  of  compiler  action,  an  object  program  with  actual 
Instructions,  is  produced,  and  it  is  in  proper  form  for  computer  execution. 

Thus,  there  is  a spectrum  of  statements  in  that  language:  the  simplest  type 

Is  an  assignment,  such  as  X:=l;  while  one  of  the  more  complex  statements  is, 
begin  ...  end,  which  group  statements  together  to  form  compound  statements 
(and  blocks). 
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In  any  higher  order  language  where  grouping  is  required,  there  is  a need  for 
so-called  delimiters  (explicit  or  implicit)  which  can  be  used  as  boundaries 
for  the  steps,  and  form  the  building  blocks  of  a program.  A similar  device 
is  required  in  the  description  of  dynamic  operations  - a means  of  grouping 
instructions  into  fundamental  operational  units. 

Generally,  the  linking  of  instructions  can  be  represented  by  means  of  a 
Boolean  indication,  with  the  value  1 used  where  the  instructions  are  or 
can  be  "contiguous",  and  0 used  to  denote  the  fact  that  they  are  not 
connected.  These  Boolean  values  could  be  used  as  entries  of  a connection 
matrix  whose  row  and  columns  are  numbered  to  accord  with  an  (arbitrary) 
numbering  scheme  for  the  steps.  But  a straightforward  application  in  this 
manner,  on  the  instruction  level,  would  normally  produce  inordinately  large 
and  unmanageable  connection  matrices.  Some  of  the  redundant  information  in 
such  a matrix  could  be  eliminated  if  certain  agreements  can  be  made:  for 

example,  if  step  1 is  always  followed  in  sequence  by  steps  2,  3,  and  4 
and  there  is  not  opportunity  for  branching  until  step  4 (at  least),  then 
steps  1 through  4 can  be  merged  or  combined,  and  three  of  the  rows  and  columns 
of  the  connector  matrix  could  be  eliminated.  This  reduction  in  redundancy 
is  an  additional  reason  for  choosing  groups  of  instructions  for  the 
description. 

Because  certain  instructions  or  statements  have  more  than  one  output(such 
as  ifs. . .than. . .e£ae)  there  is  a need  to  devise  a convention  which  will  permit 
identification  of  each  of  the  exits.  If  statement  A is  a single-output 
statement  and  it  connects  to  statement  B which  has  multiple  outputs,  the 
notation  [A,B),  which  is  "closed"  on  the  left  and  "open"  on  the  right,  is 
meant  to  imply  that  A is  executed  and  control  is  passed  to  (or  toward) %, 
but  that  B is  not  executed,  but  it  is  next  in  line.  If  B is  a two-output 
instruction  and  connects  to  L]  and  l-2»  then  both  [B,L])  and  [B.L2)  are  used 
to  describe  the  optional  branches  which  can  be  taken. 

The  procedure  which  has  been  described  can  be  so  far,  by  a flow  diagram  of 
a very  simple  program.  In  Figure  1 Is  a combination  of  a code  listing  on 
the  right  and  a flow  diagram  on  the  left.  Numbers  refer  to  the  Instructions 
listed.  The  program  is  designed  to  process  a sequence  (one  or  more)  of 
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lists,  with  each  list  consisting  of  "test  scores"  augmented  by  the  number  -1 
(which  is  not  a test  score);  the  last  list  is  further  augmented  with  a -2 
(for  HALT  purposes).  The  program  tallies  the  number  of  scores  within  each 
list  which  are  at  least  as  large  as  70  (passing),  and  also  tallies  the  total 
number  of  passing  scores  within  all  lists  (the  Grand  Sum). 

To  continue  with  the  description,  it  will  be  seen  in  Figure  1 that  the 
first  connection  to  a branching  instruction  is  made  at  instruction  number  3. 

From  3 the  branch  taken  is  determined  by  the  predicate  (X=-2)  and  how  the  input 
to  3 (carried  out  of  2)  values  it  (true  or  false).  Thus,  instruction 
number  3 is  connected  to  14  and  to  4,  as  potential  (operating)  successors  to  3. 

In  the  same  way,  5 as  a branching  statement  connects  to  6 and  10. 

A variation  of  the  technique  which  is  usually  employed,  characterized  by 
connecting  "nodes"  (representing  sets  of  instructions)  is  proposed  here. 

Emphasis  in  this  variation  is  on  the  branches  which  emanate  or  terminate 
with  branching  instructions,  and,  in  fact,  the  fundamental  or  "atomic" 
element  in  the  representation  of  a program  is  taken  to  be  a segment  or  string 
of  instructions  between  two  branching  instructions.  More  precisely  a 
segment  is:  a sequence  of  instructions  starting  with  either  a START,  or 

a branching  instruction,  and  ending  (but  not  inclusively)  with  the  first 
subsequent  branching  Instruction,  or  a HALT,  in  which  particular  case  the  segment 
is  considered  to  include  the  instruction  which  ends  it. 

As  an  example  of  the  way  segments  are  developed,  the  flow  diagram  in 
Figure  1 is  analyzed: 

51  • [1,2,3) 

52  - [3,14,15] 

53  » [3,4,5) 

54  « [5,10,11,12,13,3) 

55  = [5,6) 

Sfi  * [6,8,9, 5) 

S7  * [6,7 ,8,9,5) 


The  distinction  between  brackets  and  parentheses  is  important  and  has  been 
noted.  The  only  cases  where  square  brackets  are  used  on  the  right  are  those 
in  which  the  last  instruction  listed  is  a HALT  (number  15  in  the  example). 

Any  particular  set  of  values  (for  the  coordinates)  of  the  input  vector  (point 
in  the  input  space),  causes  exactly  one  sequence  of  operations  to  be  executed. 
These  segments  linked  together  form  a logical  path  through  the  program. 

It  is  useful  to  modify  the  term  logical  path  with  the  word  realizable  when 
input  data  can  cause  it.  Before  data  is  entered,  possible  (or  feasible) 
logical  paths  can  be  formed  by  any  concatenation  of  contiguous  segments 
which  have  the  START-segment  first  and  end  with  a HALT-segment.  In  the  case 
a program  has  self-contiguous  segments  (loops)  or  one  or  more  concatenations 
which  join  end-to-end,  the  number  of  (possible)  repetitions  of  the  joined 
segments  is  arbitrarily  large  - except  where  a predetermined  number  of 
traversals  are  specified  in  the  program. 


The  following  sequences  of  segments  in  the  program  of  Figure  1 are  illustrative 
of  some  possible  or  feasible  logical  paths: 


S1S2 

S1S3S4S2 

S1S3S4S3S4S3S5S6S4S2 

S1S3S5S6S4S2 

S1S3S5S7S4S2 


The  first  path  is  of  minimum  possible  length,  linking,  as  it  does,  the 
START  - and  HALT  - segments.  The  last  two  are  interesting  in  that  they 
exhaust  the  collection  of  segments. 

In  order  to  determine  realizable  logical  paths,  the  documentation  or  "program 
writeup"  must  considered.  In  this  simple  case  it  is  very  easy  to  establish 
data  which  will  realize  the  flows  represented  by  the  last  two  sequences 
of  the  above  list.  (It  should  be  noted  that  insofar  as  testing  to  the 
instruction-level  only  one  of  these  two  need  be  driven  but  to  obtain  segment 
or  branch- level  testing,  both  need  to  be  tested). 
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1  GSUM  - 0 


2 READ  X 

3 IF  X- -2  GOTO  14 

4 SUM  - 0 

5 IF  X - -1  GOTO  10 

6 IF  X<  70  GOTO  8 

7 SUM  + SUM  - 1 

8 READ  X 

9 GOTO  5 

10  PRINT  SUM 

1 1 GSUM  + GSUM  - SUM 

12  READ  X 

13  GOTO  3 

14  PRINT  GSUM 

15  HALT 


Figure  1.  Tart  Score*  Program  and  Flow  Diagram 


If  for  example  the  data  sequence  (stacked) 
x = 35,  -1 , -2 

is  employed,  the  next  to  the  last  sequence  of  the  above  list  describes  the 
flow,  and  for  the  "stack" 
x = 75,  -1,  -2 

the  last  sequence  describes  the  flow.  The  two  stacks  together  provide  an 
exhaustive  test  of  the  segments  of  the  program. 

Moreover,  a single  sequence  35,  -1,  75,  -1,  -2  would  also  produce  an 
exhaustive  test  of  the  segments  with  the  sequence  S-iS^SgSgSgS^S^. 

While  these  do  not  exhaustively  test  the  realizable  logical  paths  (which, 
without  further  explicit  restrictions,  are  infinite  in  number),  it  is  well 
to  note  that  the  complete  segment-testing  partially  accomplishes  one  of 
the  major  purposes  of  case  selection,  that  of  exercising  all  instructions 
so  as  to  locate  errors. 

This  limited  form  of  testing  brings  up  a very  interesting  and  very  obvious 
observation  that  is  true  for  any  program  represented  as  a collection  of 
segments:  if  a program  consists  of  k segments,  and  every  segment  can  be 

exercised  by  some  data  point,  then  only  k data  points  are  required  to 
exhaustively  test  the  program  in  the  segment  testing  sense.  This  is  of 
course  very  useful  in  the  case  that  an  interactive  or  communicative  mode 
of  testing  is  employed. 

As  an  example  of  the  way  the  segment  representation  might  be  used,  the 
previously  discussed  simple  program  is  used.  Shown  in  Figure  2 is  a 
connection  matrix  which  is  composed  of  Boolean  0's  and  l's,  with  a 1 
representing  a connection  from  the  segment  numbered-by-the-column  to 
the  segment  numbered-by-the-row.  Thus  the  element  in  the  4th  column  and 
2nd  row  has  a Boolean  1 since  the  segment  S4,  connects  (or  more  properly 
can  connect)  with  segment  S2.  as  shown  in  Figure  2. 

The  Boolean  Matrix  Algebra  is  clear  and  the  essential  rules  are  shown  at 
the  bottom  of  Figure  2.  These  rules  are  formed  directly  from  the  basic 
Boolean  Arithmetic.  As  an  illustration  of  the  use  of  the  algebra  for 
constructive  testing,  the  concept  of  "basis"  or  state  vectors  is  employed. 
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MMMMMMl 


CONNECTION  MATRIX 

ALGEBRA 

1 ® I - 1 
0 ® 0 - 0 
1 ® 1 - 1 

STATE  VECTORS 

E,  • (1.0.0,0,0.0,0)T 

E2  • 10,  i,o,o,o.o.oiT 


Figure  2.  Connection  Matrix  and  Algebra 


There  are  as  many  state  vectors  as  there  are  segments  and  they  are  denoted 
by  E] , E2,...,Em  where  is  the  transpose  of  a row  array  consisting  of  0's, 
except  for  the  ith  position,  which  contains  a 1.  These  vectors  can  be 
used  as  markers  or  tokens  to  represent  the  location  of  the  computing 
operation  at  the  "initial"  computing  time;  E3  for  example,  could  be  used  to 
show  that  at  some  arbitrarily  chosen  time,  the  site  for  computing  is  in 
segment  3.  When  E3  is  multiplied  by  the  connector  matrix,  C,  the  arithmetic 

T 

shows  that  the  vector  [0,0, 0,1 ,1 ,0,0]  results.  This  vector  can  be 
represented  as  the  vector  sum  E4+E5  and  would  represent  the  fact  that  in 
the  first  exit  from  E3,  the  computing  can  be  carried  forward  in  either 
segment  S4  or  segment  S5. 

(In  an  interactive  mode  this  might  be  used  as  follows:  if  the  data  point 

which  is  used  to  "feed"  the  program  has  previously  caused  S3  and  S4  to  be 
exercised,  the  adaptive  user,  or  tester,  would  search  for  a new  area  of 
the  input  data  space,  in  an  attempt  to  exercise  segment  S5  in  some  sub- 
sequent step  in  the  testing  process). 

The  connection  matrix  idea  has  been  proposed  in  other  applications,  notably 
by  F.  E.  Hohn  and  L.  Shissler  [5]  in  which  it  is  applied  to  hardware  switching 
circuits.  The  theory  is  well  developed  by  H.  G.  Flegg  in  his  book  [6]. 

The  algebra  of  Boolean  matrices  and  vectors  is  exhaustively  treated  by  Flegg, 
and,  although  there  is  a slight  difference  between  the  matrices  whies  depict 
software  and  those  that  depict  hardware  (each  hardware  circuit  node  is 
generally  considered  to  be  connected  to  itself,  while  in  software  this  is 
true  only  for  certain  kinds  of  loops),  the  algebras  are  not  significantly 
different.  The  rules  of  multiplication  and  addition  are  the  same,  the 
basic  associative  and  distributive  laws  hold  and  all  of  the  ordinary 
matrix  algebra  holds. 

Although  the  basic  rules  and  many  others  which  are  introduced  with  the  concepts 
of  order,  complementation,  zero,  and  identity  are  easy  to  verify,  the  require- 
ments for  any  of  these  more  extensive  rules  are  essentially  non-existent.  (Some 
50  rules  have  been  verified  but  have  little  promise  in  our  applications). 

Of  interest  to  software  applications  are  some  of  the  simple-to-describe  techniques 
involving  multiplication.  One  of  these  has  been  noted  above  where  the  state 
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vectors  are  "propagated."  In  a more  interesting  application,  it  is  easy  by 
matrix  manipulation  to  find  if  there  is  an  eventual  link  between  a given 
segment  and  another  in  a program  which  has  n segments.  It  is  only  necessary 
to  "raise"  the  nxn  matrix  to  the  first  n powers.  The  remote,  or  subtle, 
i.e.,  multi-step  connection,  if  it  exists,  will  be  manifested  by  a Boolean  1 
in  the  position  corresponding  to  the  1st  order  connection  between  the  two 
segments.  As  a matter  of  fact  and  interest  if  ordinary  (real  number)  matrix 
multiplication  is  used  instead  of  Boolean  algebra,  the  number  which  occurs 
after,  say,  k multiplications  represents  the  number  of  different  paths 
that  join  the  two  segments  in  exactly  k steps. 

C.  V.  Ramamoorthy  has  developed  the  basic  technique  (using  real  numbers 
as  well  as  Boolean  symbols)  to  some  very  interesting  results.  In  the 
majority  of  applications  Ramamoorthy  [7]  employs  the  concept  of  a generating 
function  from  node  i to  node  k.  For  a given  connection  matrix,  C,  the 
generating  function  is 


where  explicitly 

G.k(z)  = (I-Cz)-1 

where  I is  the  identity  matrix  and  z is  a dummy  variable.  Under  the  non 
Boolean  interpretation  (i.e.,  real  numbers)  of  the  connection  matrix,  C, 
as  an  nxn  matrix,  the  factor  gm  represents  the  total  number  of  ways  of 
reaching  node  k from  i in  m-steps. 

Although  it  should  be  stated  at  this  point  that  the  apparent  promise  of 
achieving  useful  results  in  studies  of  software  has  not  been  met,  for  reasons 
which  are  described  later,  it  is  well  to  note  what  can  be  done  by  developing  4 

the  fundamental  concept.  Several  important  theorems,  lenmas  and  observations, 
derive  from  the  use  of  the  generating  function  and  its  companion  function, 
called  the  characteristic  function  |l-Cz|,  where  the  vertical  lines  denote 
the  determinant  of  the  matrix  I-Cz.  (It  is  noted  that  this  concept  is  used 
in  ordinary  matrix  theory;  the  characteristic  function  determines  the  so- 
called  eigenvalues  of  the  matrix). 
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It  is  worth  noting  that  the  sophistication  offered  by  the  generating  function 
does  not  seem  to  produce  any  result  not  otherwise  obtained  with  as  much 
facility  by  the  connection  matrix  and  Boolean  operations  as  defined  above. 
Nonetheless,  a review  of  Ramamoorthy 's  findings  are  described  in  terms 
of  the  characteristic  and  generating  functions. 

One  of  the  easily  obtained  results  is  that  GSE(z),  (S  for  start  and  E for  end) 
is  equal  to  zero  if  and  only  if  there  is  no  path  linking  S to  E.  If  the 
coefficients  gm  are  accepted  as  the  number  of  ways  of  reaching  E from  S this 
is  clear:  otherwise,  the  aforementioned  technique  employing  powers  of  the 

connection  matrix  can  be  used. 

Because  a directed  graph  which  has  no  single-step  loops  has  zeros  on  the 

diagonal  of  the  connector  matrix,  and,  further,  must  have  at  least  one 

of  the  matrix  elements  or  C (the  symmetric-about -the  diagonal  elements) 

equal  to  zero,  the  determinant  j I -Cz | will  be  constant,  so  that  the  inverse 

matrix,  which  is  formed  by  taking  the  quotient  of  cofactors  of  the  matrix 

and  this  determinant,  consists  of  polynomials  of  degree  at  most  n.  Thus, 
n 

GSEU)  = l g^1 
i=0  1 

for  loop-less  graphs.  For  the  general  case  the  characteristics  function  is 
a polynomial  and  G^fz)  is  an  infinite  "series".  So  the  above  shows  that  the 
largest  exponent  of  the  generating  function  is  finite  when  there  are  no 
loops.  The  converse  is  also  true  since  gm  will  be  non-zero  if  there  are  loops. 

The  concepts  of  a strongly  connected,  and  maximally  strongly  connected  graphs 
and  subgraphs  are  due  to  Ramamoorthy  [8].  A graph  (or  subgraph  - one  obtained 
from  a given  graph  by  taking  a subset  of  its  nodes  and  retaining  all  of  the 
connections  between  these  nodes  and  inserting  no  others)  is  strongly  connected 
if  and  only  if  any  node  can  be  reached  from  any  other.  Maximal  strongly 
connected  (M.S.C.)  subgraphs  are  defined  with  respect  to  particular  nodes. 

For  a given  node,  it  is  the  largest  strongly  connected  subgraph  that  contains 
that  node.  It  is  unique  for  a given  node. 

When  both  GSE(z)  and  GES(z)  are  not  equal  to  zero,  the  two  nodes  S and  E 
belong  to  the  same  strongly  connected  subgraph,  since  they  are  mutually 
reachable. 
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An  essential  node  with  respect  to  gse(  z)  is  defined  to  be  one  which  is  reach- 
able from  S and  can  reach  E.  Under  the  same  conditions  for  GSE(z)  and  GES(z) 
(i.e.,  f 0)  it  is  true  that  any  essential  node  w.r.  to  G$E(z)  is  essential 
w.r.  to  GES(z).  (S  and  E are  always  (by  definition)  essential  w.r.  to  GSE (z ) ) . 
This  is  so  since  any  essential  node  on  the  "forward"  path  from  S to  E is 
either  on  a "reverse"  path  which  is  known  to  exist  (Ges(z)/0)  and  is  therefore 
essential  to  G^z)  or  it  can  be  linked  first  to  E then  to  any  one  of  the 
reverse  paths  to  S. 

Ramamoorthy  uses  these  concepts  and  facts  to  develop  means  of  analytically, 
i.e.,  by  matrix  manipulation,  determining  when  a graph  has  structural 
flaws  in  the  form  of  entrance  but  no  exit,  or  redundant  (i.e.,  not  essential) 
nodes  w.r.  to  S and  E. 

The  criterion  G^e(z)^0  can  be  determined  by  forming  a "reachability"  matrix 
(with  Boolean  elements)  by  logical  operations  on  the  rows  and  columns  of  the 
connector  matrix. 

The  major  structural  theorem  is  that  a graph  is  strongly  connected  if  and  only 
if  G^(z)^0  for  all  nodes  i and  j. 

Loops  can  be  detected  through  use  of  the  reachability  matrix.  (It  is  well  to 
note  that  the  Boolean-element  connector  matrix  can  be  used  to  achieve  this: 
by  examining  the  main  diagonal  of  the  powers  of  the  connection  matrix. 

For  that  matrix  there  is  no  need  to  go  beyond  the  nth  power  of  an  nxn  matrix). 

The  presence  of  strongly  connected  subgraph  is  made  manifest  by  the  presence 
of  all  l's  (Boolean)  in  the  matrix  formed  by  taking  the  logical  conjunct 
of  the  reachability  matrix  and  its  transpose.  A given  directed  graph  can  be 
partitioned  into  separate  maximal  strongly  connected  subgraphs,  and  these 
could  conceivably  serve  as  aids  to  determining  isolated  regions  for  testing. 

As  noted  above,  for  program  testing  and  for  describing  the  operational  sequence 
caused  by  data,  this  technique  does  not  appear  to  be  very  useful,  at  least 
in  the  form  which  presently  Is  employed  to  depict  them.  The  reason  for  this 
Is  that  all  of  the  potential  path  segments  must  be  used,  and  would  be 
represented  as  arcs  between  the  graph  nodes.  Hence  while  nodes  may  be  connected 
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"topologically"  there  may  be  no  logical  or  numerical  way  for  them  to  be  connected 
(as  part  of  an  execution  sequence).  It  may  be  noted  that  the  use  of  this 
technique  in  hardware  circuitry  where  "hard"  connections  exist  between  points, 
has  been  described  by  W.  Mayeda  and  C.  V.  Ramamoorthy  [9].  Nonetheless, 
this  technique  is  useful  in  eliminating  flaws,  as  noted  before,  and  it  probably 
will  have  use  in  testing  of  programs  in  an  interactive  mode.  It  would  be 
necessary  in  that  case  for  the  user  to  employ  the  numerical  values  of  the 
program  variables  which  result  during  a particular  execution  sequence,  so  as 
to  direct  the  computation  along  his  chosen  paths.  But  his  choice  of  these 
paths  could  be  materially  aided  by  the  isolation  of  maximally  strongly 
connected  subgraphs.  This  would  be  the  case  even  if  the  arcs  of  the  directed 
graph  represent  only  potential  program  subpaths. 

It  has  been  suggested  by  M.  Lipow  [10],  that  the  mathematical  subfield  of 
Lattice  Theory  may  have  application  in  the  analysis  of  programs.  In  particular, 
it  is  proposed  that  the  number  of  test  cases  required  for  exhaustive  testing 
can  be  deteremined  by  application  of  theorem  due  to  R.  P.  Dilworth  [11]. 

In  the  suggested  application  the  entities  which  have  been  defined  earlier 
as  segments  serve  as  nodes  of  a directed  graph,  while  the  arcs  of  the 
graphs  represent  transfers  between  segments. 

Using  the  order  relation  (x  - y)  between  two  elements,  x and  y,  to  mean  y 
can  be  reached  from  x as  defined  in  the  earlier  discussion;  a program  can  be 
represented  as  a partially  ordered  set.  Elements  which  are  comparable  can 
be  put  into  chains  linking  together  those  that  stand  in  the  "forward  reaching" 
relation.  Mutually  inco»iparable  elements  can  be  considered  to  comprise 
what  is  called  an  anti  chain.  Execution  sequences  form  chains  from  an 
initial  node  (starting  segment)  to  the  end  node  (halt  segment).  Dilworth 
showed  that  the  smallest  number  of  disjoint  chains  in  a partially  ordered 
set  is  equal  to  the  largest  number  of  mutually  incomparable  elements  of  the  set. 
Lipow  showed  that  the  requirement  that  chains  be  disjoint,  can  be  altered. 

He  showed  that  the  theorem  is  true  if  the  chains  are  all  maximal  chains 
(i.e.,  like  logical  paths  In  software). 
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This  fact,  as  with  the  Ramamoorthy  (et.al.)  results,  is  promising,  but  they 
cannot  be  applied  as  a direct  measure  of  the  number  of  realizable  logical 
paths.  The  reason  is  as  before  stated,  there  is  no  way  of  knowing  what 
potential  paths  actually  are  linked  together  until  input  data  is  employed 
to  produce  execution  sequences. 

B.  Analytical  Background  for  Generation  of  Random  Numbers 

1.  Introductory  Comnents 

Described  below  are  the  specifications  for  a program  or  subroutine  which 
will  provide  random  numbers  for  use  as  input  variables  to  programs  under  test. 
All  variables  are  confined  to  a finite  range  so  that  truncation  is  required 
in  order  to  use  distributions  such  as  the  normal  (Gaussian)  or  exponential, 
which  have  infinite  ranges.  In  order  to  fit  any  distribution  to  the  finite 
range  it  is  necessary  to  do  some  initial  processing  in  order  that  those 
computer  programs  which  have  been  developed  as  standard  coirmercial ly 
available  routines  can  be  used.  The  analysis  required  is  described  here. 
Appendix  I contains  a description  of  the  program  (in  Section  II,  Test  Case 
Preprocessor) . 

IMSL  (International  Mathematical  and  Statistical  Libraries)  subroutines 
exist  for  many  probability  laws  including  the  beta,  uniform,  and  normal  laws 
discussed  here.  In  order  to  develop  numbers  from  an  arbitrary  range,  meeting 
other  requirements  with  respect  to  shape  and  moments  it  is  necessary  to 
develop  relations  which  will  preprocess  and  postprocess  the  data  entering  into 
or  coming  from  these  subroutines. 

In  the  following  sections  such  processing  as  is  required  for  three  distributions 
Is  given:  the  beta  distribution,  triangular  distribution  and  the  truncated 

normal . 

2.  Beta  Distribution 

The  routine  for  generating  beta-distributed  variables  which  is  included  in  the 
IMSL  package  requires  as  Input  two  parameters  p and  q which  are  required  to 
be  multiples  of  1/2.  The  probability  density  function  In  terms  of  these 
parameters  Is  given  by  the  formula 

F(x)  - r(p+g)  xp-l  (l-x)q_1  (1) 

r(p)  r(q) 

on  the  Interval  0-  x-  1,  and  F(x)*0  elsewhere. 
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A variable  linearly  related  to  the  beta  variable  through  the  linear  transfor- 
mation 

u = L + Rx 

is  also  beta  distributed.  This  is  a convenient  form  to  start  with,  since  u 
can  be  assigned  to  an  arbitrary  interval  by  specifying  the  lower  limit  L, 
and  the  range  R. 


The  following  relations  between  the  variables  hold 


E(u)  = L+RE(x) 

2 _ d2  2 

o = R o 

u x 

M = L+Rx_ 
m 


(2) 

(3) 

(4) 


2 

where  E is  the  expectation  operator  (or  average),  ox  is  the  variance  of  x, 
M is  the  mode  (location  of  the  most  likely  u value)  and  xffl  is  the  mode  of  x. 


The  relations  (2),  (3),  and  (4)  can  be  solved  to  obtain  the  mean,  variance, 
and  mode  of  the  standardized  beta  variable.  The  mean  and  variance  of  this 
variable  whose  density  is  given  by  (1)  are 

E(x)  = _2_  (5) 

p+q 

ox2  = pq  (6) 

(p+q)2(p+q+l) 

The  mode  is 


x 


m 


-B=2- 

p+q-2 


(7) 


One  of  the  difficulties  with  using  the  beta  distribution  is  that  arbitrary 
assignments  to  the  mean,  variance  and  mode  cannot  be  made.  Fortunately,  there 
is,  for  this  distribution,  a wealth  of  experience  developed  (in  the  early 
1960's)  during  the  analytical  background  for  the  PERT  technique. 

Some  of  the  early  workers  in  PERT  used  two  approximations  that,  while  limiting 
the  family  somewhat,  served  well  In  the  sense  of  producing  realistic  results: 
the  standard  deviation.  In  all  cases,  was  chosen  to  be  1/6  of  the  range  (R),  and 
the  average  was  taken  to  be  1/6  (L+4M+U),  where  L and  U (U*L+R)  are  the  lower  and 
upper  limits  of  the  variable,  and  M is  the  "most  likely”  value. 
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Recapping,  the  process  can  be  carried  to  the  point  of  determining  the  parameters 
p and  q by  selecting  L,  R,  and  M,  computing  E(u)  as  E(u)=l/6  (L+4M+U), 
computing  a by  taking  1/36  of  the  squared  range  (R£)  and  solving  equations 
(2)  and  (3)  for  E(x)  and  a2x  (=1/36). 

It  is  necessary  to  develop  a solution  to  equations  (5)  and  (6).  To  do  so  m, 

2 

is  used  to  replace  E(x)  and  m?  is  used  to  replace  o , then 
ml  = _EL 

p+q 

m2  = JS 

(p+q)2(p+q+l ) 


Put  u=p+q  and  q=u-p 
then 


ml  = E 
u 

m„  = p(u-p) 
u2(u+l ) 

and 

_ um^u-untj)  _ 

2 p 

u (u+1)  u+1 

so 

u = ( 1 -m-j ) -1 

hence 

wu 

P = H (m^l-m^-mg) 
m2 

(8) 

and 

q = (l-m1 ) (ffl1(1-m1)-m2) 

(9) 

m2 

This  general  solution  can  be  specialized  in  the  present  case. 

since  m2=l/36 

ps  = m1  (36m^(l-m-|  )-l ) 

(8a) 

and 

qs  = ( 1 -m1 ) (36m1  (1  -m1  )-l ) 

(9a) 
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Since  G6BET,  the  IMSL  routine  which  provides  random  numbers  under  a beta 
probability  law,  requires  p and  q to  be  multiples  of  1/2  the  nearest  lattice 
point  to  the  computed  (PS»PS)  point  should  be  taken. 


3.  Triangular  Distribution 

The  general  form  for  the  triangular  density  Is  given  In  Figure  3 


CR118 


Figure  3.  Triangular  Dentity 


For  a density,  the  area  must  be  1 , so  that 


1/2  (c-a)  h-1 
or  h ■ 


In  general , 

Prob  (t  < z)  * 
and  In  particular 

For  z < b ■ 


2 

c-a 


/f(x)dx 


a 

z 


a < z 


/ J_ 

a c 


1 c 

a < z < b 


and  for  z>b 

Prob  (t  < z) 


2 

c-a 


1 

FT 


o 

(z-a)  a < z < b 


/ _L.  L£dx 

c-a  a c-a  c-b 

tsu  J_  1 [<c-bl2 

c-a  c-a  FT  [ 2 
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Simplifying, 

F(z) 


2 

1 (z-a)  a ^ z ^ b 

c-a  b-a 


b < z < c 


Using  (F(z)  as  the  function  relating  the  variables  z and  u,  that  Is,  for 
u*F(z) 

It  Is  known  that  generally 


Pudu  - Pzdz 


where  py  and  pz  are  densities  for  the  variables  at  corresponding  values,  and 


■ <*1*1 
dz 


p ■ pz  * pz 

u sr  - 


1 


a?  z 

so  that  u Is  uniform  on  F(a)*0  to  F(b)*l. 


Since  F(z)  Is  monotone.  Its  Inverse  function  exists  and  the  variables  u and  z 
can  be  related  through  the  Inverse, 

z*F_* (u). 

The  Inverse  function  Is  given  by 

z ■ a+  >/(c-a)  (b-a)u  for  0 <_  u j 

■ c-  >/ (c-b)  (c-a)  (1-u)  for  < u <,1. 


(10) 

(10a) 


In  operation  u Is  chosen  on  the  range  0 to  1,  tested  as  to  whether  It  Is  less 
or  greater  than  -f-  and,  depending  on  the  result  one  or  the  other  of  the  for- 
mulas  Is  used  to  determine  the  Z variable,  which  Is  a triangularly  distributed 
variable. 

4.  Truncated  Normal  Distribution 

As  a result  of  the  operation  of  the  GGNOR,  the  IMSL  subroutine  for  generating 
numbers  used  a normal  probability  law,  N normal  variables  are  produced,  each 
of  which  has  a mean  value  of  zero  and  a standard  deviation  of  unity. 
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The  usual  application  Is  to  convert  the  standard  normal  variable  Into  one  with 
a mean  m and  a standard  deviation  o.  This  Is  done  by  multiplying  the  standard 
normal  variable,  xn,  by  a and  adding  m,  that  Is 

2 ■ oxn+m 

Is  a normal  variate  with  mean  m and  standard  deviation  of  a 

For  present  purposes.  It  Is  desired  that  a truncated  normal  variable  be  pro- 
duced. This  can  be  done  by  specifying  any  interval  along  the  real  number  line; 
however,  for  applications  which  are  made  In  this  study,  the  Interval  has  the 
mean  m as  Its  midpoint.  Thus,  Intervals  of  the  form  (m-ko,  m+ko),  where  k Is 
any  positive  number,  are  employed. 

This  trunctated  distribution  Is  accomplished  easily:  since  the  program  for  gen- 
erating the  normal  variables  exists.  It  Is  somewhat  Inefficient,  but  mathematically 
correct  to  throw  out  those  which  are  not  In  the  range  of  the  Interval.  In  other 
words,  the  user  takes  the  normal  variables  as  they  come,  and  eliminates  those 
outside  the  range  (m-ko,  nw-ko).  Usually,  k will  be  chosen  so  that  only  a 
relative  small  proportion  of  the  generated  numbers  are  not  used:  for  k*1.96, 

about  1 In  20  numbers  are.  not  used;  and,  for  k«2.58,  1 In  100  are  not  used. 


As  a sample  computation,  suppose  that  a normal  variable  truncated  to  the  real 
number  range  [a,b]  Is  desired.  It  Is  necessary  then  to  also  specify  the 
"amount"  of  truncation  by  specifying  k - as  Indicated  above  k*1.96  will  pro- 
duce a set  In  which  about  19  out  of  20  occur  In  the  truncation  Interval.  For 
the  analysis  k Is  left  open  but  would  have  to  be  specified  as  Input  data  by 
the  user.  Since  the  normal  Is  symmetric  and,  by  the  choice  previously  cited, 
the  truncation  Interval  Is  symnetrlc  about  the  mean,  then  In  terms  formerly 
described 


a+b 

~T 


and 


b-a 

2k 


Thus  for  a,  b and  k Input,  m and  o are  produced.  These  are  used  to  modify  the 
subroutine-generated  standard  normal  variables  to  the  variate  z previously 
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defined.  The  random  numbers  are  further  subjected  to  the  truncation  limits  and  | 

eliminated  or  retained. 

C.  Program  Testing  System  (Overview) 

The  preliminary  processing  of  the  Input  data  by  PTS  provides  a set  of  FORTRAN- 
conformable  data  elements,  maintaining  the  format  which  the  program  under  test 
requires  of  the  data. 

In  order  to  collect  the  necessary  data  from  a selected  computer  program.  It  is 
necessary  to  "Instrument"  the  program  by  Insertion  of  transparent  Instructions 
which  can  collect  Information  relevant  to  the  operation  of  the  program.  The 
backbone  instrumentation  Is  provided  by  a McDonnell  Douglas  Astronautics 
Company-developed  program  called  PET.  This  Is  described  as  part  of  Appendix  I, 
which  discusses  the  special  program  PTS  (Program  Testing  System)  developed  for 
this  study.  The  preprocessor  of  this  program  automatically  generates  a FORTRAN 
program  to  prepare  data  In  the  format  required  for  the  execution  of  the  particular 
program  under  test. 

An  additional  augmentation  of  the  basic  system  consists  In  a segment  post- 
processor. This  develops  program  segments  from  the  listing,  and  subsequent  to 
the  running  of  a set  of  tests,  prints  tables  describing  the  relative  frequency 
of  use  of  each  segment. 

The  first  post-processor  report  contains  the  FORTRAN  source  listing,  followed 
by  statement  numbers  which  are  assigned  by  PTS.  Each  executable  FORTRAN  state- 
ment Is  assigned  a number.  A logical  IF  statement  is  assigned  two  numbers,  one 
for  the  IF  portion,  and  one  for  the  true  branch,  of  the  IF.  This  report  allows 
the  user  to  correlate  the  program  segments  with  the  actual  source  statements. 

The  second  report  describes  the  FORTRAN  segments  as  defined  by  PTS.  For  each  I 

test  case  a cumulative  number  of  times  each  segment  was  executed  is  shown.  At  < 

the  end  of  the  report,  the  percentage  of  the  segments  that  were  executed  for 
each  case  are  printed. 


The  third  PTS  post-processor  report  consists  in  a list  of  the  segments  and 
the  percentage  of  the  cases  that  executed  each  segment.  For  instance,  if 
a segment  is  exercised  in  13  of  14  test  cases,  93.33  would  be  printed. 

The  final  report  in  the  series  is  a summary  of  the  segments  that  were  not 
executed. 
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Ill  DETECTION  RATE  MODELS 
(PRELIMINARY) 

Described  in  this  section,  in  a preliminary  way,  are  three  detection  rate 
models,  two  of  these  were  initiated  prior  to  the  period  of  the  contract,  but 
were  developed  in  directions  which  proved  useful  to  the  problem  of  estimation 
of  the  number  of  logical  paths.  That  technique  is  illustrated  in  the  next 
section  under  a description  of  the  analysis  of  programs  when  driven  by  random 
numbers.  A third  model  was  developed  at  MDAC  during  the  contract  period  and 
while  the  results  have  been  presented  to  a national  meeting  of  a professional 
society,  there  were  no  formal  proceedings  of  that  meeting  published,  and  so 
the  description  is  presented  here.  It  is  presented  in  an  overview  form  here, 
and  in  a more  detailed  way  in  Section  V which  provides  a comprehensive  descrip- 
tion of  all  three  models. 

\ 

In  order  to  present  the  material  in  a manner  which  conforms  to  the  earlier 
published  work,  all  models  are  described  as  if  they  were  failure  or  detection 
rate  models  with  time  as  the  independent  variable.  In  the  applications  of 
these  models  to  the  major  estimation  problem  described  later,  the  independent 
variable  Is  the  trial  number  which  "runs"  like  time,  and  detection  corresponds 
to  the  finding  of  a segment  or  path  not  formerly  exercised.  The  random  nature 
of  the  input  data  makes  each  selection  an  "attempt"  to  find  a new  branch, 
where  In  the  original  context  each  unit  of  time  corresponded  to  an  "attempt" 
to  detjct  a software  error  or  anomaly. 

A.  De-Eutrophication  Model 

The  assumption  of  a uniform  detection  rate  over  a program's  development  period 
Is  unrealistic.  But  when  viewed  at  a more  microscopic  level,  uniformity  may 
have  Its  place:  over  periods  of  time  between  the  detection  of  successive  errors, 
the  assumption  of  uniformity  merely  Interprets  the  system  as  being  one  where 
any  remnant  error  (or  unexercised  path  In  the  current  context)  can  occur  at 
any  time.  The  basic  model  describing  the  detection  of  software  failures  was 
proposed  by  Z.  Jel Inski  and  P.B.  Moranda  [12]  is  indicated  in  Figure  4.  The 
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detection  rate  at  any  time  Is  assumed  to  be  proportional  to  the  current  error 
content  of  the  tested  program.  The  initial  error  content  is  then  denoted  by 
N,  and  the  proportionality  constant  is  denoted  by  0;  the  failure  rate  drops 
to  ( N- 1)0  after  the  first  error  is  detected,  and  so  forth.  The  step  size 
represents  one  "errors  worth"  of  contribution  to  the  total. 

A typical  realization  of  such  a process  is  depicted  in  the  lower  portion  of  the 
figure,  the  increasing  time  between  errors  is  purposely  Indicated  by  the  spacing. 
The  term  "de-eutrophication"  would  seem  to  be  appropriate  to  describe  such  a 
random  process.  The  data  comprising  the  observables  are  the  times  between 
adjacent  errors.  These  are  denoted  by  Xj,X2 Xp.  , 

B.  Geometric  De-Eutrophication  Process 

While  the  basic  model  presented  in  the  preceding  section  of  this  report  may 
have  much  appeal,  the  data  obtained  in  real  applications  may  not  fit  the 
underlying  assumptions.  There  are  those  who  believe  that  there  are  not  a 
finite  number  of  errors  in  a large  real-time  program:  certainly  this  is  so 
if  there  is  an  attempt  to  mirror  In  software  all  of  the  continuum  of  eventu- 
alities which  occur  In  complex  dynamic  situations.  Also,  the  assumption  that 
all  errors  have  the  same  likelihood  of  detection  is  sometimes  an  imperfect 
rendition  of  the  real  situation. 

In  a variation  of  the  basic  model,  both  of  these  are  to  a degree  alleviated. 

In  this  variation,  proposed  by  Moranda  [13],  the  step  representing  the  de- 
crease In  failure  rate  between  adjacent  Intervals,  (which  are  defined,  as 
before,  by  the  occurrence  or  detection  of  an  error).  Is  taken  to  be  a geo- 
metrically varying  amount.  This  Is  represented  in  Figure  5. 

Here  again,  the  times  are  random  variables  and  are  mutually  statistically 
Independent.  The  observables  for  use  In  the  analysis  are,  as  before,  the  time 
separation  between  adjacent  errors. 

C.  Hybrid  Geometric  Process 

This  model  was  described  by  Moranda  [14]  as  a candidate  for  depicting  the  Initial 
segment  of  hardware  system  testing.  It  covers  the  burn-in  and  steady  state  In- 
terval of  time.  The  model  also  has  applicability  to  the  software  process. 
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producing  estimates  of  the  eventual  MTTF,  or  In  the  more  relevant  context,  the 
average  number  of  trials  to  uncover  a new  segment. 

The  hybrid  or  composite  model  formed  from  the  Geometric  De-Eutrophication 
Model  and  a pure  Poisson  model.  Is  depicted  In  Figure  6.  The  three  parameters 
are:  D,  the  Initial  term  of  the  geometric  progression;  k,  the  ratio  between 
successive  terms;  and  0,  the  parameter  of  the  Poisson  process. 


31 


IV  ANALYSIS  OF  PROGRAMS 


With  the  brief  background  provided  In  the  preceding  sections,  a review  of  the 
results  obtained  In  the  application  of  the  techniques  to  three  programs  can  be 
described. 

These  programs  are  each  driven  initially  by  random  number  generators,  subse- 
quently each  Is  analyzed  as  to  the  requirements  on  the  Input  data  for  driving 
some  of  the  still  unexercised  program  segments.  In  some  cases  there  are  seg- 
ments which  cannot  be  exercised;  these  are  Identified. 

The  programs  are  discussed  In  the  order  In  which  they  were  studied.  As  a 
consequence  the  presentations  are  not  the  same.  The  first  program  Is  discussed 
at  greatest  length,  although  the  most  significant  techniques  are  discussed  In 
the  description  of  the  second  program  and  Its  test  results. 

A.  Lehmer  Root-Solver 

1.  Description  of  the  Root-Solving  Method 

The  first  program  analyzed  Is  a general  purpose  polynomial  root  solver  based 
on  the  so-called  Lehmer  method. 

This  method,  described  by  D.  H.  Lehmer  In  JACM  [15],  Is  basically  a search 
process  consisting  of  sequences  of  overlapping  circles  and  annuli  with  de- 
creasing radii  In  the  complex  plane.  While  the  procedure  Is  not  a topic 
vital  to  the  understanding  to  the  testing  process.  It  Is  well  to  describe  It 
in  some  detail  so  that  the  discussion  of  various  points  which  are  made  here 
will  be  clearer. 

For  a polynomial  f(z),  with  complex  coefficients,  rings  of  the  form 
R < | z | < 2R 

are  formed.  If,  as  It  may  be  assumed,  the  polynomial  does  not  have  zero  as  a 
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root,  f(0)  f 0,  the  process  of  doubling  or  halflng  the  radius  will  eventually 
result  in  an  annulus  which  has  no  zeros  Inside  the  Inner  ring  and  one  or  more 
inside  the  outer  ring.  A basic  algorithm  determines  when  a given  circle  con- 
tains one  or  more  roots  of  the  polynomial.  The  so-found  and  conditioned  ring 

5 

can  be  covered  by  8 overlapping  circles,  each  with  radius  gR,  and  with  centers  at 
3#(exp[^jp-^])  for  k ■ 0,  1,  2,  ....  7.  One  of  these  must  contain  at  least 
one  root.  If  taken  In  sequence,  the  first  one  which  contains  a root,  as  de- 
termined by  the  test  algorithm  mentioned  above  and  described  more  fully  later. 

Is  subjected  to  further  examination.  Because  of  the  overlap,  this  root  (or 
roots}  may  fall  outside  of  the  original  annulus;  If  so,  the  procedure  of 
successive  encircling  is  carried  out  on  that  root  until  the  value  of  the  root 
is  found,  and  then  the  procedure  Is  restarted  with  the  original  sequence  of 
circles  operating  on  the  reduced  polynomial.  (Since  all  roots  are  finite, 
the  process  of  diverging  away  from  the  main  focus  of  the  search  cannot  continue 
without  end). 

With  the  center  of  the  circle  which  is  (first)  known  to  contain  a root,  a new 
annulus  of  the  form 

R^  ^ |z-Qj | < 2Rj 

5 -ft 

(actually,  Rj  * | R 2 where  e Is  a positive  Integer)  Is  used.  This  annulus 
is  covered  by  8 circles  of  smaller  radius  and  the  first  one  containing  a root 
Is  selected.  In  this  way,  a sequence  of  circles  is  constructed  whose  radii 
form  a convergent  geometric  (null)  sequence,  and  the  root  can  be  found  to  any 
desired  accuracy. 

Fundamental  to  the  procedure  Is  an  algorithm  which  establishes  whether  or  not 
the  Interior  of  the  circle 
|z-cj  • P 

has  a root  of  the  polynomial  equation  f(z)»0. 

By  a simple  linear  transformation,  the  given  circle  can  be  transformed  to  the 
unit  circle,  and,  with  the  notation  g(z)»f(pz+c) , the  root  location  decision 
process  can  be  carried  out  starting  with  the  unit  circle  and  using  g(z)*0  as 
the  canonical  polynomial  equation. 
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The  linear  combination 

T(g(z))  * aQ  g(z)  - anzng  (z  ) 

Is  the  fundamental  device  for  producing  the  answer  to  the  question  of  whether 
the  unit  circle  contains  a root  of  g. 

T(g(z) ) Is  a polynomial  which,  by  construction,  has  no  zn  term,  and  Is  there- 
for of  degree  lower  than  n.  The  constant  term  of  T(g( z) ) Is 

T<9(0»  ■ |a„|2  - |.„|2 

If  this  Is  dlffernt  from  zero  then  T(g(z) ) (has  no  zero  root)  Is  a polynomial 
on  which  the  linear  combination  T can  be  applied,  as  before. 

2 It 

Such  a process  can  be  continued  through  the  sequence  T(g),  T (g),  . ...  T (g) 

L 

where  T (g(0))  Is  Identically  zero.  This  Is  so  since  the  degree  of  the  poly- 
nomials In  the  sequence  decreases  under  each  application  of  T. 

With  this  as  background,  the  following  fundamental  theorem  can  be  stated: 

Let  g (z)  have  no  zero  on  the  unit  circle.  If,  for  some 
h>0,  Th(g(0))<0,  then  g has  at  least  one  root  Inside 
of  the  unit  circle.  On  the  other  hand.  If  T*(g(0))>0 

L 

for  all  0<_1<k  and  T (g(0) ) Is  constant,  then  no  root  of  g 
lies  Inside  the  unit  circle. 

This  theorem  is  proved  by  the  use  of  four  lemmas,  two  of  which  are  the  Cauchy 
Integral  Theorem,  and  the  Theorem  of  Rouche;  the  other  two  have  to  de  exclu- 
sively with  polynomials  and  are  Interesting  In  their  own  right. 

The  first  of  these  Is 

Lemma:  For  P and  Q polynomials 
such  that  |P(z)|  < |Q(z)| 
on  the  unit  circle,  then  Q and  P+Q 
have  the  same  number  of  roots  Inside 
the  unit  circle. 
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The  second  lemma  Is: 

Lenina:  Let  0 be  a polynomial  of  degree  d with  no 

root  on  the  unit  circle  and  m roots  Inside.  If 
T(0(O))^O  then  T(0)  has  no  root  on  the  unit  circle 
and  has  m or  d-m  roots  Inside  according  as 
T(0(O) ) Is  positive  or  negative. 

A useful  fact  Is  developed  In  a second  theorem: 

Theorem.  The  previous  theorem  Is  true  even  If  g(z) 
has  a zero  on  the  unit  circle. 

An  example  from  Lehmer's  paper  can  be  used  to  clarify  the  procedure 
For 

g(z)  • -8z3  - 14z2  ♦ 3z  ♦ 9 
the  function  g*(z)  ■ z^z^1)  is 

g*(z)  - -8  - 14z  ♦ 3z2  ♦ 9z3 

so  that 

T(g(z))  ■ -6z2  - 5z  ♦ 1 

Hence 

T(g(0))  > 0. 


With  reappllcatlon  of  the  procedure  to  the  polynomial 
g^z)  ■ T(g(z)), 
there  results  the  function 
g*1(z)  ■ -6-5z  +z2 
and 

T2(g)  • -35z-35 

Hence 

T2(g(0))  < 0 

and  so  by  the  theorem  g has  a root  Inside  the  unit  circle. 

To  show  the  use  of  the  annuli,  the  original  polynomial  Is  transformed  by  re 
placing  z by  Then,  after  eliminating  the  common  factor: 
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Application  of  the  T-transformatlon  results  In  the  sequence 
T(g'(0))  - 320 

T2(g ' (0) ) • 880 

T3(g * (0) ) * 391 

and  ( g * (0) ) are  all  positive  and  there  are  no  roots  of  g'(z)*0  Inside  the  unit 
circle.  Thus,  for  the  original  polynomial,  there  are  no  roots  Inside  the  circle 
| z | * j.  Thus,  It  can  be  stated  that  the  original  polynomial  equation  has  one 
or  more  roots  In  the  annulus 


but  none  Inside 

iii- 1 

Actually,  the  roots  of  g(z)»0  are  3/4,  -1,  and  -3/2,  as  can  be  verified  by  sub- 
stitution. 

2.  Lehmer  Program  Description 

The  program  which  employs  this  algorithm  Is  coded  In  FORTRAN,  and  consists  of 
three  major  subroutines.  The  first,  denoted  LEHMER,  maintains  the  main  stream 
of  the  development,  forming  the  circles  and  annuli  on  the  complex  plane  and 
testing  the  criteria  for  continuing  the  search.  This  routine  uses  the  other 
two  subroutines  for  the  repetitive  operations:  the  first,  T000,  Is  used  to 
compute  the  coefficients  of  the  linear  combination  T(g(z)),  and  evaluate  the 
simpler  combinations,  such  as  T(g(0));  the  second,  S000,  Is  essentially  a poly- 
nomial evaluation  routine,  taking  the  coefficients  of  the  polynomial  f(z) 

(or  T(g(z)))  and  evaluating  them  at  particular  points. 

The  coding  for  subroutine  T000  Is  listed  In  a later  figure  (see  Figure  7).  The 
description  of  this  program  In  the  computing  manual  Is  given  below. 

LEHMER 

Double  Precision  Polynomial  Root  Finder  SUBROUTINE 


a.  Description  - This  subroutine  subprogram  finds  all  the  real  or 
complex  roots  of  a polynomial  with  real  or  complex  coefficients. 


b.  Use  - CALL  LEHMER  (ar,  al,  n,  rr,  r 1,  er,  el,  r,  z,  1,  br, 
bl,  cr,  cl,  qr,  ql,  dr,  dl , tq)  where: 

n Is  an  INTEGER  variable.  This  variable  Is 
the  degree  of  the  polynomial. 

ar  Is  a DOUBLE  PRECISION  array  dimensioned  n+1. 

The  elements  of  this  array  are  the  real 
parts  of  the  polynomial  coefficients 
beginning  with  the  constant  term. 

al  Is  a DOUBLE  PRECISION  array  dimensioned  n+1. 

The  elements  of  this  array  are  the  Imaginary 
parts  of  the  polynomial  coefficients  beginning 
with  the  constant  term. 

r Is  a DOUBLE  PRECISION  variable.  If  the 

magnitude  of  the  evaluation  check  Is  less 

then  r,  the  root  is  acceptable.  If  r Is 
-13  -5 

not  In  the  range  10  1 r <_  10  , then 

Is  used. 

z Is  a DOUBLE  PRECISION  variable.  If  the 

magnitude  of  the  difference  between  two 

consecutive  approximations  to  the  root  Is 

less  than  z,  then  the  root  Is  acceptable. 

15  -7 

If  z Is  not  In  the  range  10  <.  z <_  10  , 

.0 

then  10  Is  used. 

1 Is  an  INTEGER  variable.  If  1a0,  complex 
conjugates  of  roots  are  found  when  all  of 
the  polynomial  coefficients  are  real.  If 
1»1  then  no  complex  conjugates  are  found. 

br,  bl,  cr,  cl,  dr,  dl,  qr,  ql,  tq 

are  DOUBLE  PRECISION  arrays  dimensioned  n+1. 
These  arrays  are  used  as  working  storage. 

rr  Is  a DOUBLE  PRECISION  ARRAY  DIMENSIONED  n. 

The  elements  of  this  array  are  the  real 
parts  of  the  complex  roots. 
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rl  is  a DOUBLE  PRECISION  array  dimensioned  n. 
The  elements  of  this  array  are  the 
Imaginary  parts  of  the  complex  roots. 


er  Is  a DOUBLE  PRECISION  array  dimensioned  n. 

The  kth  element  of  this  array  Is  the  real 
part  of  the  polynomial  evaluated  at  the 
kth  root. 

el  Is  a DOUBLE  PRECISION  array  dimensioned  n. 

The  kth  element  of  this  array  Is  the 
Imaginary  part  of  the  polynomial  evaluated 
at  the  kth  root. 

c.  Support  Level  - Supported  by  Programming  Systems  and  Support 
Branch  of  Information  Processing  Systems. 

d.  Language  Used  - FORTRAN. 

e.  Availability  - On  FORTRAN  library. 

f.  Extent  - 641 4g  words. 

g.  Timing  - Not  available. 


There  are  three  programmer-specified  options:  an  evaluation  check.  In  which 
f(z)  evaluated  at  the  root,  z^,  Is  subject  to  the  test  |f(Zj)|  < r;  a con- 
vergence circle  check  In  which  successive  approximations  to  the  root  are  com- 
pared to  an  assigned  value  zeta;  and  a short-cut  which  employs  the  conjugate 
of  a found  root  In  case  of  a real  polynomial. 

3.  Analysis  of  PTT-Seoment  Data 

This  program,  when  instrumented  with  the  Program  Testing  Translator  results  In 
406  PTT-segments,  which  Include  segments  which  are  terminated  not  only  by 
branching  statements,  but  by  any  label;  thus,  a GO  TO  (LABEL)  would  be  the 
terminating  Instruction  In  a PTT-segment,  while  It  would  not  be  In  the  segments 
as  defined  earlier.  These  PTT-segments  are  useful  as  they  stand,  since  they 
provide  usage  Information  directly,  l.e.,  without  a second  processing  of  the 
Instrumented  program.  In  the  later  more  detailed  work,  these  PTT-segments  were 
used  to  develop  the  longer  segments  for  the  T000  and  S000  subroutines.  This 


resulting  composition  resulted  In  94  segments  for  the  T000  subroutine,  made  up 
from  195  PTT-segments.  The  S000  subroutine  was  composed  Into  23  segments  from 
61  PTT-segments. 


Much  of  the  early  work,  however,  was  done  using  the  PTT-segments  since  the 
statistics  which  were  developed  automatically  were  referenced  to  those  segments. 
In  the  Initial  runs  triangular,  uniform,  and  beta  distributions  (defined  In 
Section  II)  were  used. 


Described  first  Is  a typical  result.  Polynomials  of  degree  4 were  formed  by 
random  selection  of  their  coefficients  from  the  Interval  [10"^4,  1014]  using 
a triangular  probability  density  function;  the  resulting  number  for  each  co- 
efficient was  assigned  a positive  or  negative  sign  on  a 50-50  random  basis. 

A batch  of  10  polynomials  so  formed  were  employed  In  this  typical  run. 


The  first  case  (of  the  10  cases),  with  the  randomly  selected  coefficients 


aQ  * 1.427044  x 10'4 
a1  » 7.940723  x 10‘3 
a2  - 4.145428  x 10"6 
a3  ■ -2.621762  x 10‘6 
a4  « -1.066273  x 102 


bQ  » -6.719286  x 10'6 
b}  » -7.710267  x 10° 
b2  - -7.922906  x 102 
b3  « -6.921374  x 10‘3 
b4  « -5.723998  x 10+2 


exercised  204  of  the  406  PTT-segments. 


As  a matter  of  Interest,  the  resultant  polynomial  was  found  to  have  the  roots 
r}  - -8.67  x 10'8  ♦ j (1.85  x 10‘6) 

r2  ■ -9.67  x 10‘2  + j (-1.308  x 10'4) 

r3  - -5.87  x 10‘2  + j (1.16) 

r4  ■ .155  ♦ J (-1.16) 

The  degree  of  accuracy  of  these  roots  can  be  measured  by  the  evaluation  of  the 
polynomial  at  the  root  (i.e.,  f(r^),  f(r2),  etc.)  These  are 
f(r1 ) ■ -3.9  x 10"9  ♦ J (-1.4  x 10‘8) 

f(r2)  ■ -2.0  x 10“9  ♦ j (-1.5  x 10"8) 

f(r3)  • -2.0  x 10"8  + j (-1.0  x 10’6) 

f(r4)  ■ 3.2  x 10"7  ♦ j (-9.6  x 10'7) 
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These  evaluations  are  useful  for  the  typical  user,  and  it  is  interesting  to 
note  that  in  3 of  the  first  10  cases  run  (the  batch  which  is  the  subject  of 
the  discussion),  one  or  more  of  the  roots  were  not  located  with  what  at  first 
look,  would  be  judged  as  satisfactory  accuracy.  As  an  example,  one  of  the 

Q 

cases  had  a value  of  |f(r)|  of  10  . On  inspection,  the  coefficients  in  this 
case  had  magnitudes  which  with  one  exception,  vary  from  large  to  very  large 

C ? 7 *7 

(10  , 10,  10  , 10  ).  Moreover,  one  root  has  a magnitude  of  10,  and  some 
values  in  the  evaluation  of  the  polynomial  at  that  root  would  be  as  large  as 

OO  *5  7 

10  (the  Z term  has  coefficient  of  "about"  10).  Viewed  in  this  light  the 
accuracy  is  less  suspect  and  the  program  does  well  under  the  stress  imposed 
by  the  large  numbers  used. 

As  noted  before,  the  interest  is  not  in  the  correctness  of  the  programs  being 
tested;  however,  the  above  discussion  does  describe  some  of  the  details  which 
are  descriptive  of  the  program. 

a.  Aggregate  Effects 

A straightforward  table  of  the  cases  shows  the  following  sets  of  numbers 
exercised  against  the  case  number 


Table  I 

Triangular  Distribution  Results 


Case 

1 

2 

3 

4 

5 

6 

7 

8 
9 

10 


No.  of  Segments 
Exercised 

204 

199 
202 

205 

200 
197 
197 
201 
196 
208 


\ 
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The  number  not  exercised  by  any  of  the  test  cases  totaled  183.  Thus,  the 
program  was  exercised  by  at  least  one  of  the  test  cases  in  223  out  of  406, 
or  a percentage  of  54.9.  Because  the  smallest  number  in  the  above  table 
represents  49.2%,  there  is  much  overlap  in  the  testing. 

For  purposes  of  illustrating  the  analysis  described  later,  the  following  data 
is  useful.  It  lists  the  trial  number  versus  number  of  "new"  PTT-segments 
exercised.  The  initial  number  if  204  as  indicated  in  the  above  table.  Even 
though  there  are  fewer  total  in  case  2,  there  are  some  branches  (PTT-segments) 
taken  during  this  execution  which  did  not  occur  in  the  first  case.  The 
actual  number  is  6.  The  third  case  exercises  1 PTT-segment  not  exercised  by 
either  case  1 or  2.  The  fourth  exercises  5 not  previously  exercised.  The 
fifth  exercises  1 new  segment;  1 new  segment  is  found  in  case  6;  3 in  case  7; 

1 in  case  8;  none  in  case  9,  and  1 in  case  10. 

Data  of  this  type  are  useful  in  analysis  of  the  economic  stop  point.  In  the 
present  instance,  there  is  no  analysis  necessary  and  no  reason  to  stop  testing 
since,  in  all  but  one  case  there  is  a non-zero  yield  in  the  new  cases  found. 

b.  Distributional  Effects 

At  this  point,  it  1 s he'TpfaT^to  discuss  the  effects  which  different  distribu- 
tions have  on  the  results.  For'tln'r  purpose , runs  of  size  10  which  were  made 

14 

with  each  of  the  three  distributions  (uniform,  beta,  and  triangular  on  10  to 
14 

10  with  random  signs)  can  be  used. 

Intuitively,  the  beta  and  triangular  distributions  should  furnish  almost  the 
same  in-the-large  results  since  they  are  shaped  nearly  the  same.  This  indeed 
is  found  to  be  the  case.  None  of  the  cases  in  the  "beta-batch"  exercised  any 
segments  not  already  included  in  the  triangular.  This  is  probably  within  the 
"noise"  of  samples  of  this  size:  ten  additional  cases  of  either  distribution 

would  probably  show  a similar  comparison. 

On  the  other  hand,  the  triangular  (and  beta)  differ  considerably  in  shape  from 
the  uniform,  and  it  is  expected  that  there  would  be  a difference  in  the  results. 
This  turns  out  to  be  the  case,  with  10  segments  exercised  by  the  10-size 
"uniform-batch"  not  exercised  by  the  same  sized  "triangular  batch",  and,  for 
completeness,  2 in  the  latter  batch  not  in  the  former. 
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The  results  of  the  ten  cases  for  the  uniform  are  summarized  below  in  Table  II. 


Case 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 


Table  II 

Uniform  Distribution  Sample 

No.  of  Segments 
Exercised 

213 

196 
202 

187 

197 
202 

188 
199 
197 
179 


The  number  of  segments  exercised  are  nearly  the  same  as  those  for  the  tri- 
angular distribution  as  shown  in  Table  II.  As  noted,  not  only  do  the 
numbers  correspond, the  actual  paths  correspond.  Of  interest  are  cases 
1 and  10;  the  latter  has  the  fewest  actual  number  of  segments  exercised, 
while  the  former  exceeds  (by  five)  the  largest  of  the  number  found  in  any 
uniform  case. 

The  section  of  code  which  is  caused  to  be  entered  by  the  data  of  this  test 
case  is  governed  by  a test  of  the  magnitude  of  the  coefficient  of  the  highest 
degree  of  a "working"  polynomial.  The  actual  test  is  of  the  form 

IF  (*1  Im(cm)|-109)  B,B,C 

where  % is  the  mth  coefficient  of  a "working"  polynomial  and  the  B-labelled 
instruction  Is  the  entry  into  the  section  of  code.  The  imaginary  part  of  the 
working  polynomial  coefficient  Is 

Im(cm)  = (Re(a1 ) ) ( Im(am) ) - (I|n(a1  ))(Re(am)) 

But  for  m*n-l,  the  actual  data  shows 


Re(a1) 
Man_,)  - 
Ini(a1 ) 

Re(Vi)  = 


5.2  x 10"9 
3/4  x 10'12 
-4.4  x 10'13 
3.1  x 10"13 


so  that  the  branch  B is  taken  for  this  data. 


Under  a triangular  or  beta  distribution  (with  symmetry  about  the  midpoint 

-13  -12 

of  the  interval)  the  values  10'  and  10"  which  occur  in  this  uniform 
case  would  indeed  be  data  freaks. 


The  10th  case  is  of  interest  because  it  exercises  only  179  PTT-segments. 

This  is  caused  by  the  fact  that  some  of  the  coefficients  of  the  test  case 
are  very  large  (105,  105,  109,  106  for  the  first  four  coefficients).  The 
test  on  the  working  polynomial  (which  always  contains  as  one  factor  in  each 
of  four  multiplications,  either  8.9  x 1011  or  -2.1  x 105)  is  directed  away 
from  a particular  area  of  code,  represented  by  14  PTT-segments. 

These  two  cases  illustrate  the  benefit  of  testing  with  the  uniform  distribution. 
It  stresses  the  program  in  small  samples  in  a way  which  could  only  be  achieved 
by  large  samples  from  the  triangular  or  beta  distribution. 

It  is  relevant  and  necessary  in  a complete  description,  to  point  out  that  in 
programs  of  the  type  studied  here,  there  are  a great  many  CALLS  to  subroutines 
with  data  generated  by  intermediate  computations.  There  are,  for  example,  287 
calls  (in  Case  10  of  the  uniform  distribution)  of  the  major  subroutine  T000. 
Thus,  for  a single  random  number  (set)  on  the  input,  there  is  In  this  case 
a great  proliferation  of  numbers  with  which  to  test  the  segments  of  the 
subroutines. 

To  show  the  essential  difference  here,  a coarse  look  can  be  made  at  the 
segment  numbers,  which  are,  even  for  this  program  which  has  a very  large 
number  of  GOTO  Instructions,  correlated  with  the  actual  execution  sequence. 

It  Is  noted  that  the  largest  number  of  times  any  of  the  first  50  listed  PTT- 
segments  Is  exercised  Is  9,  and  this  occurred  In  a DO-loop  which  was 
entered  three  times  and  Iterated  3 times.  The  first  large  usage  number  (58) 
occurred  at  the  Instruction  which  called  T000;  the  next  significantly 
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large  number  occurred  at  an  instruction  which  has  8 different  (i.e.,  "gone  to") 
entry  paths.  The  point  to  be  made  is,  that  "early"  in  a program  the  distribu- 
tional effects  may  be  more  pronounced  than  in  later  portions  or  in  repeatedly 
called  subroutines. 

The  degree  of  the  buildup  is  clearly  shown  by  noting  that  while  there  is 
only  one  entry  to  LEHHER,  in  the  case  at  hand,  the  entry  to  T000  is  made 
308  times,  and  S000  is  entered  406  times. 

It  is  along  the  same  line,  that  the  following  observation,  which  while 
obvious,  is  of  practical  value.  It  is  a fact  that  the  large  sample  runs 
by  any  distr ioucion  over  the  same  range  on  the  input  domain  will  produce 
the  "same"  results  (i.e.,  exercise,  in  total,  the  same  program  segment). 

The  purpose  in  using  particular  distributions  is  to  reflect  the  "real" 
world  and  that  was  the  original  reason  for  choosing  different  distributions. 
This  is  of  little  relevance  in  the  area  of  testing  which  is  aimed  at 
exercising  the  greatest  number  of  program  paths.  On  the  other  hand,  it 
is  well  to  note  here,  that  particular  distributions  reflecting  reality 
have  use  in  developing  a priori  estimates  of  software  reliability.  This 
point  is  discussed  in  Section  VI. 

4.  Analysis  of  Aggregated  Segment  Data 
a.  Random  Input  Data 

It  is  instructive  to  follow  insofar  as  is  possible  a single  input  data  case 
through  the  program.  This  has  been  done  to  the  extent  possible  and  the  results 
are  presented  below. 

First,  it  is  noted  that  the  trace  through  the  entire  program  is  extremely 
tedious  and  a more  limited  investigation  is  made,  that  being  a trace  through 
the  subroutine  T000.  This  is  done  with  segments  as  defined  in  Section  II, 
and  requires  chaining  of  some  of  the  PTT-segments  which  were  employed  in  the 
analysis  above.  The  so-chained  segments  are  listed  In  Table  III  and  are 
obtained  from  the  coding  for  the  subroutine  shown  In  Figure  7.  A total 
of  94  segments  are  shown,  and  these  are  obtained  from  the  194  PTT-segments 
(and  155  Instructions)  in  the  T000  subroutine.  The  analysis  shows  that 
T000  is  called  147  times  by  the  LEHMER  subroutine  In  Case  I.  The  number 
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Table  III 
TOOO  Segments 

Tx:  [78, 273, 27U.2T5, 276, 27T, 278, 279, 280, 281, 282,283, 28U, 285, 286, 28T, 383, 38U) 

T2 : [ 38U , 385 , 386 , 387 , 388 , 389 , 286 , 287 , 383 , 381* ) 

T3:  [381*. 390) 

T*:  [390,391,392,291*) 

T5 : [ 390 , 288 , 289 , 290 , 291 , 292 , 293 , 393 ) 

Tg:  [291*,  297, 298, 299) 

Ty  [29U, 295, 296, 305) 

Tg:  [299,285, 286, 287,383, 384) 

T9:  [299,300) 

T10:  [393,391*) 

Tu:  [393,1*02) 

T12:  [305,297,298,299) 

T13:  [305,311*) 

TlU:  [305,306) 

Tx  5 : [ 300 , 303 , 30U , 285 , 286 , 287 , 383 , 381* ) 

Tlfi:  [300,301,302,376,377] 

T19:  [ 39l* , 395 ) 

T2Q:  [ 39l*  ,1*02 ) 

T21 : [ 1*02 , 3l*l* , 3l*5 ,31*6 ,31*7  ,U10 ,1*11 ) 

T22:  [1*02,291*) 

T23:  [31U.315) 

?2k:  [3lU, 316, 317, 376 ,377] 

T25:  [306,376,377] 

T26:  [306,307,308,309,328) 

T^:  [306,312,313,308,309,328) 

T2Q:  [306,310,311,308,309,328) 

T29:  [395,396) 

T3Q:  (395,1*02) 

T31:  1396,397) 

T32:  (396,1*02) 

T33 : [ 1*11 ,1*12 ,1*13  .UlV  ,1*15 ,31*5 ,3U6 ,31*7 .1*10 ,1*11 ) 

T3U:  [1*11,31*8) 

T3?:  [315,320,321,322) 

T3g:  [315,318,319,377] 

T3g:  [328,329) 

T^0 : [ 328 ,333 ,33**  ,335 ,336 ,337,338,339 ,3l*0 ,1*03  ,l*0l* ) 
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: [ 397  ,Ul6  ,UlT  ,Ul8  ,Ul9 ,398 ,399 ) 

T^2:  [ 397  ,U20,U21  ,U22 ,U23 ,U2U  ,U25  ,U26  ,U27 , 398 ,399 ) 

TU3:  [3U8 ,349,350) 

Tjjjj : [ 3U8  ,356,357) 

Tu? : [ 322 ,326 ,327 ,26p ,286 ,287 ,383 ,38U ) 

TUg:  [322,323) 

Tu?:  [329,330) 

T5Q:  [329,331,332,376,377] 

T51 : [U0U.U05  ,Uo6 ,U07  ,Uo8  ,U09 , 336 ,337 ,338,339,3^0 ,1*03  ,UoU ) 

T52:  [UOU  ,3Ul  ,31*2) 

T53:  [399,^00) 

T5lt:  [ 399  ,**01 ) 

T 55:  [350,297,298,299) 

T56:  [350,351) 

T57:  [357,358) 

T58  : [357,297,298,299) 

T58  : [357,36U,365) 

T59:  [323,376,377] 

T6q:  [323.32U, 325, 376,377] 

T6l:  [323,325,376,377] 

T62:  [330,378) 

Tg3:  [330,376,377] 

T6U : [ 330,380,381 , 382,285,286 ,287 ,383 ,38U ) 

T65:  [3U2.393) 

t66 : 1 3U2 ,3U3 ,3UU ,3U6 ,3U7 ,UlO ,Ull ) 

T^:  [UG0.358) 

Tgg:  [U00.297, 298,299, 300) 

T69:  [UOO.36U.365) 

T?0:  (U01.31U) 

Tn:  [U01, 297, 298 ,299, 300) 

T72:  (U01,306) 

T73:  [ 351, 35U, 355, 297, 298 ,299) 

T^:  [351,352,353,376,377] 

T75:  [358,359) 
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T?g:  [358,360,361,376,377] 

T77:  [378,379) 

T?g : [378,376,377] 

T?9:  [365, 366, 367, 368, 369, 370, 371) 

TQo:  [365,372) 

TQl:  [359,362,363) 

Tg2:  [359,318,319,377] 

Tg3:  [379,376,377] 

TgU : [ 379 , 380 , 381 , 382 , 28  5 , 286 , 287 , 383 , 381* ) 

Tg5:  [ 371 ,335 ,336 ,337 ,338 ,339 ,3^0  ,U03,1*0U ) 

Tg6:  [371,372) 

Tg? : [372, 37U, 375, 376, 377] 

Tgg:  [372,373) 

Tg9:  [373,378) 

Tgo:  [373,376,377] 

Tgi:  [ 373 ,380 ,381 ,382 ,285 ,286 ,287  ,383 ,38U ) 

T92:  [363,376,377] 

Tg3:  [363,320,321,322) 


i 

I 

1 

I 

{ 
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I 
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I 

I 


I 
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SUBROUTINE  TOOO  (AREAL .QOOOFL .N.TAU.S.AlPMAR. ALPHAI, 
1BREAL .BINAG.CREAL .CINAG.QR  .QINAG.TR) 

,W. 11,112. 

344 

DIMENSION  AREAL ( 1 ) ,QOOOFL ( 1 ) .BREAL ( 1 ) ,BINAG( 1 ) , 
1CRIAL(I).CIN4G(1).6r  ( 1 ) ,OINAG( 1 ) ,TR( 1 ) 

345 

346 

DOUBLE  PRECISION  AREAL,  OOOOf L . BREAL.  BINA6,  CREAL 
DOUBLE  PRECISION  CIN4G  . QR  , QINAG  . TR 

T 

347 

DOUBLE  PRECISION  S . AlPHAR  . ALPHAI  . VREAL  . 

VI  MAG 

348 

DOUBLE  PRECISION  T1  . TAU  . TK1 

W 

349 

DOUBLE  PRECISION  TK2  . CNORM 

350 

273 

CALL  OYERFK KOOOFX) 

351 

274 

GO  TO(275.275)KOOOFX 

352 

275 

N-N»l 

353 

276 

T-S 

354 

277 

LS-0 

355 

278 

LT-0 

356 

279 

LZ-0 

357 

280 

MX-1 

358 

281 

MY-1 

359 

282 

NO-0 

360 

283 

IN-11 

361 

284 

KL-4 

362 

285 

CALL  SOOO  (AREAL. QOOOFL .N.l.T. BREAL. BIMAG. 

363 

1 ALPHAR .ALPHAI .VREAL .VIMAG. CREAL .CIMAG) 

364 

2 86 

Tl-(  BREAL  ( 1 )#*2-BIN4G(  1 )**2)-(6REAL  (H)#*2^BIMAG(N)— 2) 

365 

287 

GO  TO  383 

366 

288 

NL-M 

367 

289 

CREAL  (l)-BREAL(l) 

368 

290 

CINAGfl )-BINAG(1 ) 

369 

291 

CREAL (NL)-BREAL(M) 

370 

292 

CIMAG(NL )-BINAG(M) 

371 

293 

•GO  TO  393 

372 

294 

IF(0ABS(T1)-TAU)  297.297,295 

373 

295 

LS-0 

374 

296 

GO  TO  305 

375 

297 

T-l ,500*T 

376 

298 

LS-LS*1 

377 

299 

IF  (LS-5)  285.300,300 

378 

300 

II  (IN)  303.301,303 

379 

301 

T- 32 . 000/ 729 . 000*T 

380 

302 

GO  TO  376 

381 

303 

T-10.000*T 

382 

304 

GO  TO  285 

383 

305 

IF  (T1 ) 314.297.306 

384 

306 

GO  TO  (376, 376. 376, 307, 310,312), KL 

385 

307 

KL-1 

386 

308 

NQ-0 

387 

309 

GO  TO  328 

388 

310 

KL-2 

389 

311 

GO  TO  303 

390 

312 

KL-3 

391 

313 

GO  TO  308 

392 

314 

IF  (IN)  316,315,316 

393 

315 

GO  TO  (320,320,320,320,320,318) ,KL 

394 

316 

12-1 

395 

317 

GO  TO  376 

396 

318 

W.500*T 

397 

319 

GO  TO  377 

398 

320 

T-.500*T 

399 

321 

NQ-NQ*1 

400 

322 

IF  (MO-20)  326,326.323 

401 

323 

GO  TO  (376,376,376,324.325,325) ,KL 

402 

324 

T-32.00*T 

403 

325 

GO  TO  376 

404 

326 

KL-5 

405 

327 

GO  TO  285 

406 

328 

IF  (N-lj  329,329,333 

407 

329 

IF  (IN)  331.330,331 

408 

330 

GO  TO  ( 378,376 ,380) ,KL 

409 

331 

12-2 

410 

332 

GO  TO  376 

411 

333 

JJ-N*1 

412 

334 

L-2 

413 

335 

J-JJ 

414 

336 

00  339  I-l.JJ 

415 

337 

CREAL(I)-(BREAL(1)*6REAL(I)*BINAG(1)*8IHAG(I))- 

416 

1 (BREAL (JJ )*BREAL (J )*BINAG(JJ )*BINAG(J) ) 

417 

338 

C I NAG ( I )•( BREAL (1 )#B!NAG(I )-BINAG(1 )*BREAL(I ))- 

418 

1 (BINAG( JJ)»BREAL (J  f-BREAL ( JJ )*BIN4G(J) ) 

419 

339 

J-J-1 

420 

340 

GO  TO  403 

421 

341 

NLHH2-L 

422 

342 

GO  TO  (393, 343), NY 

423 

343 

NY-1 

424 

425 

426 

427 

428 

emit 


GO  TO  346 
CONTINUE 

TR(L  )-(CREAL( 1 )**2*CIMAG( I )**2)- (CREAL (NL  )**2- 
ICimG(NL)**2) 

GO  TO  410 

IF  (DA8S(TR(L))-TAU)  349,349.356 
LT-LT^l 

IF  (IT-S)  297.351.351 
IF  (IN)  354,352.354 
T- 32. 000/729 ,000*T 
GO  TO  376 
T-10.000*T 
GO  TO  297 
LT-0 

IF  ( TR(L ) ) 358.297.364 
IF  (IN)  360,359,360 
GO  TO  (362.362.318) .KL 
12-3 

GO  TO  376 
LZ-LZH 

IF  (LZ-20)  320,320.376 
LZ-0 

IF(L-N)  366.372,372 
00  368  I-l.JJ 
BREAK  I )-CREAL(I ) 

8IHAG(I)-CIMAG(I ) 

JJ.JJ-1 

L-LO 

IF  (L-N)  335,335 .372 
IF  (IN)  374.373.374 
GO  TO  (378,376,380)  ,KL 

12-4 

GO  TO  376 

W-T 

RETURN 

IF  (ALPHAR)  376,379,376 
IF  (ALPHAI)  376.380.376 
T-2.000-T 
KL-6 

GO  TO  285 

CALL  OVERFL (KOOOFX) 

GO  T0( 385,390) .KOOOFX 
DO  387  1-1, N 

BREAL ( I )-8REAL(I )*10,00-10 
BIHAG(l)-8IMG(I)»l0.0D-10 

NX-2 

GO  TO  286 

GO  TO  (288.391), MX 

MX-1 

GO  TO  294 

IF(0A8S(CR£AL(1))-10. 00-10)  394,394,402 
IF(0A8S(CIMAG(1))-10. 00-10)  395,395,402 
IF  (0ABS(CREAL(NL))-10. 00-10)  396.396.402 
IF  (0A8S(cIM4G(nl))-10. 00-10)  397,397,402 
GO  TO  (416.416. 416. 420. 420.420). KL 

CNORM-  CRE AL ( 1 ) **2K  I NAG**2 ) - ( CREAL  ( Nl ) **2*C  I MAG  ( NL ) **2 ) 
GO  TO  (400,400,400,401 ,401 ,401 ) ,KL 
IF  (CNORM)  358.297.364 
IF  (CNORM)  314,297,306 
GO  TO  ( 345, 345. 345 ,294 .294, 294 ),KL 
CALL  OVERFL( KOOOFX) 

GO  T0(405, 341). KOOOFX 
00  407  I-l.JJ 

BREAL(I  -BREAL ( l )*10. 00-10 
BINAG( I )-0INAG(l )*10.00-10 
NY-2 

GO  TO  386 

CALL  OVERFL( KOOOFX) 

GO  T0(412. 348) .KOOOFX 
00  414  I-1.NL 

CRE AL(I)-CREAL(I)*10. 00-10 
CINAG( I )-CINA6( I )*10.00-10 
GO  TO  346 
00  418  1-1  ,NL 

CREAL (I  -CREAL (I )*10. 00*10 

cinag(i)-cinag(i)»io.oo*io 

GO  TO  398 
00  422  I-l.M 

BREAL (I )-BREAL(I)*10.00*10 
B!NAG( I )>B1NAG( I )*10. 00*10 

NL-M 

CRCAl(l ) -BREAL ( 1 ) 

CPMGM)*BimG(l) 

CttEAL  (NL  )-BRC*L  (H) 

CIKAG(w>«tMMC<) 

GO  TO  398 
EDO 


Figure  7.  TOOO  SubroutiiM  Coding 


of  times  each  segment  is  exercised  is  listed  in  Table  IV.  There  is  an 
apparent  law  of  conservation:  any  end-node  of  a segment  with  say  N counts 

must  link  to  start-nodes  which  total  N counts  (if  there  are  no  other 
linkings  to  those  nodes).  Thus,  T^  with  85  counts  and  end-node  No.  394 
links  to  T^g  with  85  and  T^q  with  zero.  This  process  becomes  complex 
because  of  loops  which  exist,  many  of  which  are  not  at  all  obvious.  Thus, 
many  of  the  segments  have  more  than  one  (apparent)  lead-in  path,  making 
the  balancing  process  somewhat  difficult.  Thus,  the  440  count  for  segment 
T-J1  and  the  85  for  segment  T^q  arise  from  two  sources,  221  from  Tg  and  304  from 

T65- 

It  is  not  feasible  to  establish  the  program's  execution  sequence  through  this 
routine.  To  do  so  would  require  a trace  from  the  start  - that  is,  from 
the  start  in  the  LEHMER  routine  - through  the  147  CALLS  of  this  routine, 
and  this  is  manifestly  impractical,  and  very  likely  impossible  from 
the  aggregate  data  alone. 

However,  potential  paths  can  be  formed.  In  some  cases,  actual  partial  paths 
can  be  inferred,  but,  in  other  cases,  no  rescue  is  possible. 

Figure  8 shows  the  paths  which  were  exercised  in  Case  1 of  the  uniform  sample. 

It  presents  a good  status  keeper  for  the  test  cases.  Of  the  93  segments 
which  are  included  in  T000,  the  case  which  was  selected,  exercised  50  segments 
(the  figure  53.7%  of  segments  agrees  very  well  with  the  52.46%  figure  for 
the  PTT-segments;  these  should,  of  course,  correlate  well,  but  the  closeness 
in  actual  values  is  fortuitous). 

From  the  printout  for  the  10-size  "uniform"  - batch,  the  "union"  of  all  segments 
exercised  can  be  found.  This  is  shown  in  Figure  9.  A total  of  54  segments 
out  of  93  are  included. 


GO 


Table  IV 

TOOO  - SEGMENT  USAGE  (CASE  I) 


T3 

221 

T41 

71 

T85 

100 

T5 

221 

T42 

12 

T87A 

88 

T7 

209 

T44 

233 

T88 

47 

T10 

85 

T47 

56 

T89 

17 

T11 

440 

T52 

304 

T90 

14 

T13 

17 

T53 

71 

T91 

16 

T14 

192 

T54 

12 

T93 

41 

T19 

85 

T57 

55 

T21 

233 

T58B 

178 

T22 

209 

T65 

304 

(Remainder  are 

T23 

17 

T67 

14 

T26 

146 

T69 

57 

r*. 

CSJ 

1- 

16 

T72 

12 

T28 

42 

T75 

41 

T29 

85 

T76 

28 

T31 

83 

T77 

2 

T32 

2 

T78 

15 

T34 

233 

T79 

100 

T37 

15 

T80 

135 

00 

ro 

*— 

2 

T81 

41 

T40 

204 

T84 

2 

CR118 


b.  Special  Test  Cases 

The  preferred  method  of  testing  is  one  where  a naive  user  can  employ  the  program 
documentation  and,  on  the  basis  of  the  description  given,  test  all  options. 

This  program  is  lacking  in  the  kind  of  detailed  description  needed.  (As  a 
means  of  more  closely  obtaining  the  kind  of  testing  environment  conceived  as 
desirable,  a second  program  using  the  same  general  problem  (polynomial  root 
solving)  was  instrumented.  That  program  is  described  in  the  next  subsection). 
The  desired  condition  not  attaining,  it  is  still  possible,  by  examination  of 
the  code,  to  find  cases  which  will  drive  some  of  the  branches  and  to  find 
some  impossible-to-exercise  branches. 

First,  with  respect  to  one  of  the  options  which  directly  affect  the  flow  of 
control,  the  choice  1=0  (which  was  set  on  the  initial  run  and  never  changed) 
specifies  that  if  the  coefficients  are  all  real  then  conjugate-pairs 
of  roots  are  found.  It  is  noted  from  code  analysis  that  segments  T^g,  T24, 

TgQ»  T73.  T75.  and  Tg7  are  all  "started"  by  this  condition  on  this  index. 

Tg0  and  T73  depend  only  on  other  segments  which  were  not  exercised. 

Of  those  remaining,  only  T 7g  and  Tg7  are  exercised  and  these  are  exercised 
presumably  by  a second  pass  in  which  there  is  an  override  on  the  conflicting 
data  (complex  coefficients,  but  1=0). 

Among  the  possible  segments,  it  is  easy  to  identify  some  of  the  causes  that 
certain  segments  are  not  exercised.  For  example,  the  initial  overflow  can 
only  be  caused  by  choosing  input  data  which  is  severely  taxing.  In  the 
data  described  so  far,  the  initial  overflow  test  cannot  be  made  true  since 
all  data  is  in  the  range  10"14  to  10-14.  Later  tests  are  also  made  but  they 
too  are  in  most  cases  not  made  true,  even  though  much  intermediate  processing 
involving  products  of  large  numbers  takes  place.  Segments  T^,  T33,  and  Tg^ 
are  overflow  segments  not  taken  (these  are  easy  to  identify  as  the  only 
(obvious)  loops  in  Figure  9 which  start  and  end  on  the  same  node. 

Similarly,  several  tests  are  made  on  a program  variable  representing 

the  working  value  of  T(g(0)).  These  are  made  with  respect  to  a program- 

specified  value  of  10  . Specifically,  T(g(0) ) must  have  a magnitude 

30 

of  less  than  (or  equal  to)  10  In  order  to  have  Tg  in  the  execution 
sequence.  While  this  can  be  achieved  easily,  as  shown  in  the  next  paragraph. 


64 


it  would  be  (or  would  have  been)  convenient,  to  merely  increase  the  value 

On  c 

of  tau  (10  ) to,  say,  10  (the  accuracy  of  the  roots  may  suffer,  but 

this  is  not  a real  consideration). 

To  continue  with  this  point,  it  is  noted  by  code  inspection,  that  branch  Tg 
can  be  taken  provided 


a requirement  met  by  setting  ag=an.  This  of  course,  "never"  occurs  for 
randomly  generated  data.  So  this  case  is  one  which  essentially  must  employ 
examination  of  the  code. 

In  an  elaboration  of  this  kind  of  case  construction,  examination  of  the  code 
shows  that  the  following  list  of  segments  which  are  not  exercised  but  which 
are  affected  by  "zero-relations"  among  the  program  variables  at  entry:  Tlg, 

T16’  T12’  T49’  T74»  T58A’  T68*  T71 ' is  wel1  to  note  here’  however 
that  not  all  of  these  are  directly  dependent  on  values  of  the  input  variables 

some  of  them  are  transfer  controls.  Listed  below  are  all  of  the  segments 

which  were  (possible)  and  were  unexercised  after  the  10-size  uniform 

random  drivers  were  used,  with  those  of  the  above  listed  set,  together 

with  the  overflow  test  branches  mentioned  above,  either  encircled  (zero 

tests)  or  "ensquared"  (overflow  tests). 
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Table  V 

Unexercised  Segments 


I 

I 


•Most  of  the  zero-tests  can  be  expected  to  be  exercised  since  as  noted 
they  involve  control  transfers  or  the  running  down  of  the  equivalent  of 
index  registers.  Those  are  marked  by  an  asterisk  in  the  table.  Others 
such  as  T12,  Tgg,  T^  are  dependent  on  continuous  variables. 
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] 

] 
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(1)  Fundamental  Combinations 


It  is  interesting  to  illustrate  here  the  way  in  which  efficient  testing  can  be 
developed  on  the  remaining  segments.  If  the  status  represented  by  the  Figures 
8 and  9 above  attains,  and  assuming  Tg  has  not  been  exercised,  it  is  noted 
that  the  node  numbered  99*  (at  the  end  of  the  arrow  representing  Tg)  has  the 
property  that  all  arrows  exiting  from  it  (Tg  and  Tg)  are  zero.  This  means 
necessarily,  that  all  segments  leading  into  that  node  are  not  exercised. 

Thus,  for  example,  because  Tg  and  Tg  are  not  exercised  it  can  be  ensured 
that  T12,  T73,  Tj-5,  T58A  are  not  exercised. 

This  forms  the  seed  of  a method  for  searching  for  "fundamental"  combinations 
of  segments,  and  although  not  explored  in  the  present  contract  seems  to  be  of 
promise  in  an  interactive  mode  of  test  case  selection. 

These  combinations  can  be  found  from  the  list  as  constructed  in  Table  V, 
by  locating  segments  with  the  same  start  node  which  all  have  zero  usage. 

The  following  combinations  are  found  to  be  linked  in  the  manner  suggested 


T 

T 

T 

T 

T 

T 

T 


15'T16 

49'T50 

55"T56 

59”T60“T61 

62*T63“T64 

73'T74 


T6‘  T12*  T73*  T55*  T58A 
V T68*  T71 


♦Because  of  (self-imposed)  display  constraints,  there  are  a few  nodes  with 
non-unique  numbers  - there  are  two  99-labeled  nodes,  for  example. 
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This  formation  would  be  very  easy  to  program  and  would  be  very  useful  even 
though,  in  some  respects,  it  is  backward,  for  it  does  not  always  specify 
which  of  multiple  drivers  will  produce  the  necessary  data  to  drive  the 
segments.  On  the  other  hand,  as  the  last  five  combinations  show,  the  drivers 
may  be  clear  but  the  "driven"  is  not.  (It  is  fundamental  that  the  out-degree 
of  every  node  of  the  graph-representation  of  the  program  by  segments  is  2 
or  more,  and  that  this  ambiguity  is  therefore  inevitable). 

In  developing  a strategy  for  testing,  the  nesting  of  the  combinations  can 
produce  the  likely  best  choices.  Thus,  T^  if  exercised  will  exercise  either 
T55  or  Tgg,  and,  in  turn,  either  Tg  or  Tg  in  the  former  case,  or  T 73  or 
in  the  latter  case.  Tgg  will  exercise  either  T4g  or  Tgg,  and  the  former 
would  exercise  Tg2  or  Tgg  or  Tg4.  In  developing  a metric  for  the  degree 
of  testing  achieved,  it  is  well  to  realize  that  T43  "represents"  3 segments 
which  will  be  exercised,  similarly  Tgg  "represents"  3. 

(2)  Special  Cases 

The  only  segments  which  are  not  among  the  set  of  fundamental  combinations 
and  are  not  overflow  or  zero-dependent  are:  T25,  Tgg,  T7Q,  Tg2,  Tgg,  Tg2. 
These  are  discussed  as  "special  cases"  here,  but  of  course,  the  fundamental 
combinations  and  zero-  and  overflow-dependents  are  also  special  cases. 

T2g:  Analysis  of  this  shows  that  this  segment  requires  T1  (a  "working" 

value  of  T)  to  be  greater  than  zero,  OR  CN0RM>0,  AND  the  index  variable 
KL=1 ,2,  or  3.  The  first  two  conditions  are  (probably)  met.  Entry 
To  T25  comes  from  either  T72,  which,  if  exercised  at  all,  "carries" 
one  of  the  values  K=4,5,  or  6;  or  from  T^,  which  does  not  change  KL, 
and  which  comes  from  T^  which  again  does  not  change  KL,  and  which,  in 
turn,  comes  from  T4  or  T22.  But  T4  is  overflow  dependent,  as  noted 
earlier,  while  T22,  which  was  exercised,  can  only  "carry"  the  value 
KL=4. 

This  means  that  T25  can  only  be  exercised  on  an  overflow,  along  with 
T4  and  T2.  (Note  again  that  T2,  T4  and  T25  are  ( probably)! inked; 
however,  in  a less  certain  way  than  is  the  case  with  the  fundamental 
sets). 
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Tg6:  This  segment  requires  the  value  MY=2  AND  to  be  exercised. 

But  MY=2  is  set  only  by  one  instruction  (408)  which  is  contained 
only  in  T,^  , which  is  an  overflow  path.  Thus,  Tgg  is  linked  to  the 
overflow  segment,  precisely  as  with  the  preceding  case. 

T^q:  The  segment  requires  KL=4,  5,  or  6.  Thus,  T41,  which  requires 

KL=1,2,  or  3 cannot  be  the  driver  and  T42  1s  the  only  potential  source. 

It  does  carry  KL=4,5  or  6.  The  code  shows  that  failing  a test  for 

magnitude  on  the  real  and  imaginary  parts  of  an  and  a . these  are 

10  u n 

all  multiplied  by  10  and  a new  test  is  made  on  the  difference. 

It  is  reasonable  to  expect  that  this  segment  would  have  been  exercised. 

The  code  on  Instruction  numbered  398,  indeed,  does  look  wrong:  the 

code  which  reads  CIMAG**2,  should  be  CIMAG(1)**2.  (Whether  or  not 
this  is  a real  or  only  an  apparent  error  was  not  being  investigated; 
it  is  noted  that  the  original  code  is  the  same  and  it  is  not  a 
typing-translation  error). 

Tg2 : This  segment  depends  on  some  rare  but  not  impossible  computational 
values.  It  is  necessary  for  KL=3  and  this  is  attained.  Additional 
cases  should  exercise  this  branch. 

Tgg-.  This  segment  depends  on  the  predicate  L>N  being  true.  (For  the  case 
at  hand,  N=4).  On  the  other  hand,  Tg6  depends  exclusively  on  T7g. 

But  in  order  for  T7g  to  be  exercised,  it  is  necessary  for  L to  be 
less  than  N.  But  L Is  increased  by  1 unit  at  a time;  hence,  the 
case  L=N  is  reached  ahead  of  the  test  L>N  and  Tgg  can  never  be 
exercised. 

T^:  This  branch  requires  a loop  counter  in  excess  of  20.  For  the 
data  used,  this  did  not  happen.  Each  time  the  subroutine  is  entered 
the  counter  is  set  to  zero  In  initialization  and  it  Is  set  to  zero 
on  exit.  This  branch  should  be  exercised  in  a different  sample. 
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(3)  Constructed  Cases 


1.  The  first  case  consisted  of  assigning  as  input  a 1st  degree  polynomial 
(-.004z+3=0)  with  real  coefficients,  without  error  check.  This  simple 
choice  exercised  only  24  segments  of  T000;  but  among  these  are  the  segments 
T39.  T^g,  T50,  Tg£»  Tg3,  Tg4,  none  of  which  had  been  exercised  by  the 
random  tests.  The  string  T^g,  Tg2,  Tg3,  Tg4  form  a fundamental  combination 
and  T3g,  T^g,  Tgg  form  another. 

2.  This  case  was  a 1st  degree  polynomial  with  complex  coefficients,  specifi- 
cally (-. 004+3. 2i )z+(3.0-.07i )=0.  No  error  check  was  used.  This  caused  a 
subset  of  the  case  1 segments  to  be  exercised. 

2 

3.  A second  degree  polynomial  specifically  10. 8z  -.004z+3.0=0,  with  real 
coefficients,  roots  computed  without  conjugates,  and  no  error  checks, 
resulted  in  one  new  segment,  Tg2,  (as  well  as  Tg3  which  had  been  exercised 
by  random  numbers). 

4.  This  consisted  of  a polynomial  of  degree  2,  with  complex  coefficients 
without  error  check  and  without  conjugates.  No  new  segments  were  exercised. 

5.  This  case  consisted  of  a degree  2 polynomial.  The  "conjugate"  choice 

was  made:  that  is,  one  root  is  found  by  taking  the  conjugate  of  the  other. 

-14 

An  error  bound  of  r=10  was  employed.  No  new  segments  were  executed. 

6.  A degree  3 real  polynomial,  no  conjugates,  no  error  check  comprised 
case  6.  Segments  T2g,  T7g,  and  Tgg  were  exercised,  but  these  had  been 
exercised  by  at  least  one  of  the  random  cases.  (In  addition,  for 
summary  comparison  purposes,  6 new  PTT-segments  in  the  LEHMER  and  S000 
were  exercised). 

7.  A complex  polynomial  of  degree  3,  without  error  checks  and  without  con- 
jugates, was  used.  Segments  Tg2,  Tg^,  and  T^  were  new  segments.  Tg^  and 
T2i  had  been  exercised  by  random  numbers.  (Seven  PTT-segments  among 

the  LEHMER  or  S000  were  exercised). 
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Case  8 - A 4th  degree  real  polynomial  without  conjugates  and  no  error  check 
was  used.  » Tg^  were  exercised,  both  of  which  had  been  exercised  by 
the  random  cases  (Three  PTT-segments) . 

Case  9 - A 4th  degree  complex  polynomial  without  error  check,  and  without 
conjugate  was  used.  No  new  segments  were  exercised. 

c.  Status  of  Testing  (Random  and  Selective) 

Tg':  Overflow  is  required 

T^:  Overflow  dependent 

T,:  Exercised  with  a =a„ 

o no 

Tg:  Exercised  when  conditions  on  Tg  are  met.  ^ 

Tg:  Can  be  exercised  by  a polynomial  with  roots  which  have  a small 

magnitude,  but  whose  coefficients  are  sufficiently  large 
to  exceed  the  value  of  tau  (lO’"^). 

T^:  Requires  Tj  = 0,  but,  if  this  were  to  occur,  the  segment  T& 

(starting  at  294)  (and  not  T7)  would  be  exercised.  But  Tg 
and  T^  are  not  compatible.  T^  CANNOT  BE  EXERCISED. 

T15-  Exactly  one  of  these  will  be  exercised  when  TQ  is  exercised. 

T^g:  The  former  would  be  exercised  when  conjugates  are  specified 
and  the  latter  when  they  are  not. 

T2g:  This  was  discussed  above  under  the  section  title.  Special  Cases. 

This  is  overflow  dependent  (on  T^). 

T^3 : This  segment  is  an  overflow  test  branch. 

T39:  This  was  exercised  by  the  case  of  a first  degree  polynomial 
(Constructed  Case  No.  1). 

T43:  T^e  conditions  are  the  same  as  for  Tg. 

T^g.*  This  would  be  exercised  when  conjugates  are  specified  and  would 
be  exercised  by  Constructed  Case  No.  1,  if  that  option  were 
specified. 

T^g:  This  is  exercised  by  Constructed  Case  No.  1. 
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T5Q:  This  is  exercised  by  Constructed  Case  No.  1. 

T5j : This  is  an  overflow  test  branch. 

Tgg:  This  segment  would  be  exercised  with  Tg  on  the  first  pass 

through  a loop:  T55-T9-T1 5-T3-T5"Tl 1 _T21 “T34~T43~T55 * 

T5g:  This  segment  would  be  exercised  on  the  fifth  passage  through 

the  same  loop.  A higher  degree  polynomial  would  exercise 
this  segment. 

T^q : This  requires  a working  value  of  T (g (0) ) to  be  zero.  This 

can  only  be  achieved  by  an  extremely  rare  event.  While  not 
impossible  to  exercise,  it  is  very  unlikely  that  it  will  be. 

Tgg:  This  segment  requires  T48  to  be  Exercised  and  KL=1 , 2,  or  3. 

T^8  is  conjugate  choice  dependent.  This  segment  will  be 
exercised  with  a higher  degree  polynomial. 

Tgg:  This  requires  KL=4,  and  since  it  can  be  achieved  with  almost 

any  choice  on  initial  input.  T4g  must  be  driven,  however. 

T^:  This  requires  KL=5  or  6 which  can  be  met  when  T4g  is  driven. 

Tgg:  Exercised  by  Constructed  Case  1. 

Tg^ : Exercised  by  Constructed  Case  1. 

T64:  Exercised  by  Constructed  Case  1. 

Tgg:  This  segment  is  described  above.  It  is  linked  to  overflow. 

Tgg : This  segment  requires  CN0RM=0  and  KL=1 , 2,  or  3.  With  well 

chosen  coefficients  this  will  be  exercised  from  the  top. 

T^q : This  segment  has  been  discussed  above  under  Special  Cases.  There 
may  be  a coding  error  in  the  program. 

T^, : This  segment  requires  CN0RM=0  and  KL=4,  5,  6. 

T^jj  This  requires  1=1,  and  will  be  exercised  with  any  data. 

T^:  This  requires  1=0  and  would  be  exercised  when  Tgg  is 

Tgg:  This  was  exercised  by  the  7th  Constructed  Case. 

Tgg:  As  shown  In  the  analysis  under  Special  Cases,  this  segment 
CANNOT  BE  EXERCISED. 
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Tg2;  This  segment,  discussed  above  under  Special  Cases,  willbe 
exercised  with  a higher  degree  polynomial. 

d.  Summary  of^  Analysi  s 

First,  with ^respect  to  the  quite  limited  testing  which  was  done,  it  is  noted 
that,  excepting  the  overflow  or  overflow-dependent  segments,  those  which 
are  dependent  on  the  choice  1=1  and  which  would  have  been  exercised  with  that 
choice,  those  which  cannot  be  exercised,  and  those  which  are  directly 
dependent  on  these,  the  number  of  segments  exercised  by  random  testing  with 
the  small  sample  of  10  exercised  54  of  80  possible  segments. 

It  is  useful  in  this  respect  to  note  that  the  usual  problem-proofing  procedure 
consists  of  running  a set  of  simple  cases  (check  problems)  such  as  those 
listed  under  Constructed  Cases.  It  is  noted  that  the  union  of  segments  exer- 
cised by  one  or  more  of  these  tests  numbered  only  16.  The  total  possible 
can  again  be  taken  to  be  80. 

From  the  results  of  this  simple  comparison  it  seems  clear  that  the  random 
or  blind  testing  (although  to  be  sure  other  Constructed  Cases  - especially 
higher  degree  polynomials  - would  produce  a higher  yield  than  those  employed), 
is  very  effective  in  testing  a program. 

Presented  in  Figure  10  is  a modified  flow  diagram  in  which  three  essential 
changes  are  made  to  the  original  diagram:  the  impossible  segments  are 

deleted,  the  conjugate-choice  option  corresponding  to  1=1  are  eliminated, 
all  overflow  or  overflow  dependent  segments  are  deleted.  In  addition, 
an  exit  on  the  occurrence  of  a zero  or  negative  degree  is  deleted  along 
with  the  segments  which  (after  the  previously  described  deletions)  are 
dependent  only  on  that  condition  (segments  T3g,  T4g,  Tg2,  Tg3,  and  Tg^  are 
so  affected). 

This  figure  shows  clearly  the  degree  to  which  these  random  tests  exhaust 

the  possible  branches.  It  is  also  clear  from  the  figure  what  additional 

tests  need  to  be  developed.  On  application  of  Constructed  Cases  which 

are  discussed  above,  the  segment  Tg2  and  Tg2  were  exercised.  It  Is  again 

clear  where  the  focus  should  be  placed  for  the  additional  segments.  For  example, 

T43  If  exercised,  will  add  a minimum  of  2 and  as  many  as  3 segments. 

S3 
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B.  IMSL  Routine  ZPOLYR 


1.  Description  of  Root-Solving  Method 

Because  of  the  difficulty  in  tracing  through  the  unstructured  program  which 
was  written  for  the  Lehmer  method,  a second  polynomial  solver  was  selected 
using  the  criterion  that  the  documentation  be  more  adequate  and  the  listing 
more  easy  to  follow.  This  was  supplied  by  an  IMSL  Library  program  named  ZPOLYR.* 

This  program  uses  the  Jenkins-Traub  (16)  three-stage  algorithm.  Some  of  the 
difficulties  which  the  original  program  had  are  discussed  in  the  analysis 
to  form  constructed  cases.  The  major  deficiencies  seem  to  be:  in  the 

original  program  the  largest  roots  were  extracted  first  and  the  resultant 
"deflated”  polynomial  - obtained  by  factoring  out  a quadratic  - on  occasion, 
produced  apparent  zero-valued  roots;  the  degree  limitation  was  raised  to 
100  in  the  new  or  replacement  program;  zero  leading  coefficients  cause  an 
instant  error  exit. 

2.  ZPOLYR  Program  Listing 

This  program  is  conmerclally  available  and  the  listing  Is  available  in  the  IMSL  Library. 

3.  Analysis  of  PTT-Segments 
a.  Sumnary  Data 

In  the  first  run,  a sample  of  size  10  from  a triangular  distribution  was  used. 

The  range  of  this  distribution  on  the  logarithm  of  the  coefficients  was 
[-14,  +14]  with  a mode  of  +2.  Signs  were  chosen  by  parity  of  random  numbers. 

The  degree  was  chosen  to  be  4.  The  percentage  of  segments  exercised  by  these 
cases  (PTT-segments  wero  used)  were  as  shown  in  Table  VI. 


*This  program  and  a major  subroutine  were  both  replaced  by  IMSL  in 
1975. 
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Case  No. 
1 
2 

3 

4 

5 

6 

7 

8 

9 

10 


Table  VI 

ZPOLYR  Segment  Usage  (Run  #1) 


% Used 

44.68 

44.68 

65.96 

65.96 

50.35 

44.68 

54.61 

65.25 

65.96 

44.68 


Number  Used 
63 
63 
93 
93 
71 
63 
77 

92 

93 
63 


Run  #2  used  the  same  degree  (4),  and  a uniform  distribution  on  the  logarithm 
of  the  coefficient  over  the  range  [-14,  14].  A sample  of  size  20  was  used. 

Insofar  as  segment  usage  is  concerned,  the  results  were  as  shown  in 
Table  VII. 


Table  VII 

ZPOLYR  Segment  Usage  (Run  #2) 


Case  No. 

%_ 

No. 

Case  No. 

% 

No. 

1 

60.28 

85 

11 

39.72 

56 

2 

62.41 

88 

12 

54.61 

77 

3 

61.70 

87 

13 

65.25 

92 

4 

65.25 

92 

14 

63.83 

90 

5 

54.61 

77 

15 

46.81 

66 

6 

46.10 

65 

16 

52.48 

74 

7 

45.39 

64 

17 

39.72 

56 

8 

46.81 

66 

18 

69.50 

98 

9 

50.35 

71 

19 

68.09 

96 

10 

60.28 

85 

20 

54.61 

77 

The  numbers  here  shown  are  both  larger  (69.50)  and  smaller  (39.72)  than  for 
the  10-sample  triangular  case.  This  effect  is  probably  more  due  to  the 
distributional  difference,  than  to  the  sample  size.  The  uniform  distribution 
can  pick  large  values  (1  to  10^)  for  the  coefficients  as  frequently  as  small 
values  (numbers  in  the  range  10"^  to  1). 

Examination  of  the  printout  for  the  two  cases  (11  and  17)  which  exercised  the 

fewest  number,  show  a lack  of  convergence:  "La  Guerre 's  Method  has  failed 

to  converge."  The  input  data  in  case  11  showed  a coefficient  of  about  1.5 

x 10®  for  the  z3  term  and  1.0  x 10"®  for  the  z^  term  and  -4.5  x 10~4  for 

-14  3 

the  coefficient  of  z.  Case  17  had  coefficients:  6.5  x 10  , 1.2  x 10  , 

-8  2 -12 

-4.9  x 10"  , 1.1  x 10  , 2.4  x 10"  . The  apparent  conclusion  is  that 

because  of  a failure  to  converge,  there  was  a quick  exit. 

Actual  segment  usage  data  for  the  Case  11  shows  (a  typically)  zero  usage  in 
the  program  from  instruction  132  to  195  (assuming  continguity  of  numbers 
implies  something  about  the  actual  operating  sequence),  corresponding  to  a 
program  section  which  "extracts"  a quadratic  factor  from  the  original  or 
reduced  polynomial.  Entry  into  this  section  is  governed  by 
the  test  as  to  whether  or  not  the  nth  iterative  approximation  is  "close 
to  the  real  axis  relative  to  step  size."  Case  17  shows  a similar  usage 
pattern . 

Before  going  into  an  analysis  of  the  program  and  construction  of  special  cases, 
the  several  additional  run  results  are  presented. 

Run  #3  employed  a quadratic  with  15  samples  and  a uniform  distribution.  All 
samples  exercised  the  same  (small)  number  of  segments,  12.  Furthermore, 
they  all  exercised  exactly  the  same  segments.  Part  of  the  reason  for  the 
light  usage  Is  mentioned  above;  basically  It  Is  the  degree  of  the 
polynomial  which  causes  the  light  usage. 

Run  #4  was  characterized  by  choosing  a polynomial  of  degree  12,  uniform 
distribution  on  the  log  of  the  coefficients  over  the  same  range  employed 
before,  and  a sample  size  of  15.  Table VIII  summarizes  the  usage  data. 
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Table  VIII 

ZPOLYR  Segment  Usage  (Run  #4) 


Case  No. 

% Used 

No.  Used 

Case  No. 

% Used 

No.  Used 

1 

65.25 

92 

2 

68.09 

96 

9 

67.38 

95 

3 

69.50 

98 

10 

40.43 

57 

4 

66.67 

94 

11 

69.50 

98 

5 

62.41 

88 

12 

68.79 

97 

6 

67.38 

95 

13 

68.09 

96 

7 

65.25 

92 

14 

68.09 

96 

8 

64.54 

91 

15 

64.54 

91 

Run  #5 

employed  40  samples. 

a 4th  degree  polynomial. 

and  a uniform  distri- 

bution 

as  before.  Table 

IX 

summarizes  the  usage  data  for  the 
Table  IX 

ZPOLYR  Segment  Usage  (Run  #5) 

run. 

Case  Nc 

i.  % Used 

No 

. Used 

Case  No. 

% Used 

No.  Used 

1 

39.72 

56 

21 

43.97 

62 

2 

45.39 

64 

22 

46.81 

66 

3 

44.68 

63 

23 

68.09 

96 

4 

45.39 

64 

24 

36.17 

51 

5 

61.70 

87 

25 

44.68 

63 

6 

46.81 

66 

26 

49.65 

70 

7 

69.50 

98 

27 

60.28 

85 

8 

46.81 

66 

28 

45.39 

64 

9 

47.52 

67 

29 

61.70 

87 

10 

44.68 

63 

30 

44.68 

63 

11 

44.68 

63 

31 

44.68 

63 

12 

46.81 

66 

32 

46.81 

66 

13 

45.39 

64 

33 

63.83 

90 

14 

50.35 

71 

34 

70.92 

100 
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Table  IX 
(continued) 


Case  No. 

% Used 

No.  Used 

Case  No. 

% Used 

No.  Used 

15 

56.03 

79 

35 

44.68 

63 

16 

44.68 

63 

36 

60.28 

85 

17 

69.50 

98 

37 

62.41 

88 

18 

44.68 

63 

38 

62.41 

88 

19 

60.28 

85 

39 

69.50 

98 

20 

63.12 

89 

40 

51.06 

72 

Finally,  a run  with  a 15th  degree  polynomial  and 
the  summary  usage  data  depicted  in  Table  X. 

a sample  size 

of  15  produced 

Table  X 

ZPOLYR 

Segment  Usage  (Run  # 6) 

Case  No. 

% Used 

No.  Used 

Case  No. 

% Used 

No.  Used 

1 

68.79 

97 

9 

67.38 

95 

2 

64.54 

91 

10 

68.79 

97 

3 

61.70 

87 

11 

67.38 

95 

4 

65.25 

92 

12 

65.25 

92 

5 

65.96 

93 

13 

65.96 

93 

6 

65.25 

92 

14 

64.54 

94 

7 

65.96 

93 

15 

67.38 

91 

8 

68.79 

97 

b. 

Estimation  of  Total  Number  of  Execution  Sequences 

(1)  Introduction 

The  Interesting  pattern  In  the  above  data  Is  the  separation  between  the  trial 
numbers  at  which  the  "new"  or  apparently  "new",  execution  sequences  are  found. 
If,  as  is  initially  assumed  each  execution  sequence  (or  realizable  logical  path) 


ee 
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has  the  same  chance  of  being  exercised  when  random  numbers  are  used  as  input, 
then  the  number  of  these  paths  can  be  estimated  by  applying  a model  developed 
by  Jelinski  and  Moranda  for  a different  purpose.  That  model  was  described  briefly 
in  Section  I II. There  are  some  necessary  changes  in  interpretation,  however: 
in  the  original  model,  the  number  of  software  errors  contained  in  a package 
is  the  equivalent  of  the  number  of  execution  sequences  here.  Time,  which 
was  the  independent  variable  in  the  original  model,  is  made  to  be  the  analog 
of  trial  number  in  the  variation.  When  an  error  is  detected  and  corrected, 
the  original  model  assumes  a detection  rate  which  is  correspondingly  reduced 
(by  one  unit);  in  this  application  a new  execution  sequence  is  noted  by 
comparing  the  pattern  of  the  segments  exercised  against  all  earlier  occurring 
sequences. 

Because  execution  sequences  are  characterized  by  the  particular  segments  driven 
(and  the  order  in  which  they  are  executed)  the  total  number  listed  in  the 
preceding  tables  are  not  sufficient.  They  are,  of  course,  very  useful  since 
if  the  totals  are  different  then  necessarily  the  execution  sequences  are 
different. 

There  is  a pair  of  fine  points  which  need  to  be  acknowledged  and  which  indeed 
help  in  the  definition  of  what  is  here  called  an  execution  sequence.  First, 
it  is  possible  for  the  PTT-segment  usages  to  be  identical  in  two  cases  while 
the  actual  sequences  could  differ;  no  information  is  available  to  decide  such 
fine  differences.  Second,  two  cases  may  exercise  exactly  the  same  PTT-segments 
but  with  different  numbers  on  one  or  more  of  the  segments  and  these  are 
classified  as  the  same.  For  many  purposes,  including  the  purpose  of  thorough 
test,  both  of  the  interpretations  are  acceptable  variants. 

(2)  Technique 

For  the  analysis  given  here  for  illustration  of  a technique,  the  runs  2 and  5 
are  merged  together  to  form  a sample  of  size  60.  These  are  numbered  from 
1 to  20  through  the  Run  2 sample  and  21-60  through  Run  5.  As  noted  above. 

It  is  easy  to  determine  by  inspection  of  summary  data,  the  first  nine 
cases  represent  different  execution  sequences.  Case  10  not  only  has  the 
same  % usages  as  Case  1,  but  identical  segment  usage.  Case  12,  on  the  other 
hand,  has  a different  execution  sequence  from  Case  5,  even  though  they 
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have  the  same  total  segment  usage.  Similarly,  Case  13  is  different  from 
Case  4 although  they  have  the  same  total  count.  Taking  each  case  number 
in  sequence,  if  it  is  different  in  total  from  all  the  preceding,  it  represents 
a new  execution  sequence;  if  it  is  the  same  as  one  or  more  earlier-listed 
ones,  it  must  be  closely  examined  against  all  of  them  with  the  same  usage  %'s, 
to  see  if  it  indeed,  is  a different  case. 

The  following  sequence  of  numbers  is  formed  as  follows:  a 1 is  recorded 
if  there  is  a new  sequence  found  and  a zero  if  there  is  not.  The  sequence 
of  0's  and  l's  versus  case  number  is: 


1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

1 

1 

1 

1 

1 

1 

1 

1 

1 

0 

1 

1 

1 

1 

0 

16 

17 

18 

19 

20 

21 

22 

23 

24 

25 

26 

27 

28 

29 

30 

1 

0 

1 

1 

0 

0 

0 

1 

0 

0 

0 

1 

1 

1 

0 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

0 

1 

1 

1 

1 

0 

1 

0 

0 

1 

1 

1 

0 

1 

0 

46 

47 

48 

49 

50 

51 

52 

53 

54 

55 

56 

57 

58 

59 

60 

1 

0 

0 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

1 

The  formulas  developed  for  the  De-Eutrophication  model  are: 


i=l  N-(i-l) 


(i-l)x. 


NT  - I (i-l)xi 

In  the  present  application,  n will  stand  for  the  number  of  execution  sequences 
found  during  a number  of  cases  T (one  case  per  unit  of  time).  N is  the 
unknown  number  of  execution  sequences  (not  to  be  confused  with  the  polynomial 
degree  which  has  the  same  notation):  the  number  which  could  eventually  be 

exercised  by  a 4th  degree  polynomial  whose  coefficients  are  chosen  at  random 
In  the  manner  Indicated.  Xi  represents  the  "time"  between  the  discovery  of 
new  execution  sequences.  If  this  happens  In  consecutive  cases,  this  number 
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is  taken  to  be  1.  0 is  a proportionality  constant  and  represents  "one 
execution  sequence"  worth  of  detection  rate  (starting  with  a value  N0  for 
the  detection  rate  and  decreasing  by  one  on  each  discovery.) 

The  data  so  defined  becomes 


X-j  = 1 , X2=l , X3=l,  X4=l,  X5=l,  X6=l,  X7=l,  Xg=l , Xg=2,  X10=l, 

Xll=1»  X12=1*  X13=2,  X14=2,  X15=1,  X16=4’  X17=4,  X18=1* 
xl9=l,  X2q=3,  X21=l,  X22=l,  X23=l,  X24=2,  X25=3,  X2fi=l, 


x27=l.  x28=2,  X29=2,  X30=8,  X31=6, 


If  it  were  assumed  that  only  the  first  20  cases  (i.e.,  the  Run  #1  data)  were 
available,  then  the  following  processed  data  would  apply:  XTX15  as  above, 

x^=2  (at  least  2 units  to  the  next  detection,  based  on  the  best  "current" 
knowledge  - that  at  trial  number  20);  n=16;  T=20.  This  results  in  a ratio 
£(i-l )X1-/20  = 8.4  and  this  ratio  completely  determines  the  parameters  N and  0. 


Tables  have  been  constructed  to  solve  those  equations  and  are  found  in 
Appendix  II.  From  these  tables  the  following  information  is  found  for 
the  ratio  (8.4)  and  n=16. 

N = 31.82 

Var(N)  = 29.54  (standard  deviation  of  5.4) 

The  total  number  found  after  60  cases  is  31,  an  agreement  so  close  as  to 
retire  explanation.  It  is  noted  that  "time"  has  by  no  means  run  out  and 
the  60th  case  showed  a new  discovery.  Hence,  the  total  error  content  is 
larger  than  31,  and  the  agreement  is  fortuitous.  By  way  of  further  illus- 
tration and  to  erase  the  impression  that  this  technique  is  as  accurate  as 
luck  has  made  It  appear  at  first  sight,  the  first  40  trials  are  analyzed. 

Aqafn.  the  data  at  X^X^  is  as  before,  Xlg  is  now  "revealed"  to  be  4 
’*t*ed  of  the  value  2 which  served  as  the  current  best  value  before), 

./  «n  I ,-I?g  ,r*  as 

n 

w,*  • •*»  rat  to  ' (i-DXj/40  is  found  to  be  13.4.  From  the  tables 

••  *'  estimate  for  N in  this  case,  is  50.25  and  the 


standard  deviation  of  the  estimate  is  6.1.  The  realized  (so  far)  value  of 
31  falls  barely  short  of  the  3o  lower  limit  of  acceptability,  but  of  course 
would  increase  with  larger  samples.  Computation  with  the  total  sample  of 
60  produces  for  n=31 , a ratio  of  18.46  and  an  estimate  of  40.5  with  a 
standard  deviation  of  2.95.  This  is  the  best  estimate  and  is  certainly  a 
reasonable  one.  In  the  long  run,  and  60  is  not  considered  long,  thris  is 
the  expected  number  which  will  be  exercised  in  this  way.  The  value  obtained 
is  noteworthy  in  at  least  two  respects.  The  conventional  myth  about  execution 
sequences  is  that  there  are  a very  great  number  (10^  for  even  reasonable 
sized  programs)  of  them.  The  evidence  seems  to  indicate  that  for  this  rel- 
atively small  program  this  is  not  the  case.  On  the  other  hand  with  141 
segments  with  which  to  form  sequences  and  a rough  estimate  of  70  two-way 
predicates  to  consider,  there  are  reasons  to  believe  that  there  would  be 
a great  number  of  sequences.  Again,  this  does  not  seem  to  be  the  case. 

Of  course,  this  observation  must  be  put  in  context.  The  choice  of  the  degree 
as  4 in  all  of  the  above  analyses  may  have  prevented  a great  number  of  the  141 
segments  from  being  used.  (This  effect  is  very  clear  for  the  quadratic  - 
Run  #3  showed  all  15  cases  had  exactly  the  same  segment  usage). 

This  point  was  investigated  with  inconclusive  results.  An  analysis  of  the 
segment  usage  data  for  a run  made  with  a polynomial  of  degree  12  (Run  #4), 
produced  the  following  pattern  of  1's  and  0's  (using  the  above  interpretation): 
1,1, 1,1, 1,1, 1,1,1, 1,1, 1,0,1 

indicating,  at  first  look,  a large  number  of  sequences.  But  the  initial  segment 
(of  14)  of  the  corresponding  sequence  In  the  preceding  analysis  showed  a similar 
pattern  but  produced  many  duplicates  in  the  next  10  cases.  If  the  data 
from  Run  #6  (not  quite  comparable  because  it  inputs  a polynomial  of  degree  15) 
is  used  together  with  the  Run  #4  data,  there  is  seen  to  be  indications  of 
duplicates  (within  the  run  (#6),  and  with  that  of  Run  #4).  Closer  analysis 
was  not  made. 

It  seems  fairly  sure  that  the  number  of  execution  sequences  is  much  smaller 
than  is  ordinarily  thought. 

a 
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(3)  Summary  and  Extensions 
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The  technique  employed  above  in  the  illustration  provides  the  only  known 
practical  means  of  estimating  the  number  of  execution  sequences.  The  alter- 
native procedures  involve  the  solution  of  a number  of  simultaneous  logical 
equations  formed  from  the  program's  predicates,  and  result  in  a very  large 
number  of  equations  and  no  clear  solution  in  case  the  program  functions 
(those  that  change  program  variables)  are  non-linear. 

This  technique  has  two  variants  which  amount  to  application  of  models  developed 
by  Moranda  [13]  and  [14].  The  first  model  treats  detection  of  errors  (or 
new  execution  sequences  in  the  present  case)  as  random  a process  in  which  the 
detection  rate  decreases  In  a geometric  progression  on  the  occurrence  of 
each  error  detection  (and,  correction  in  the  case  of  errors). 

Because  of  the  importance  of  this  and  the  earlier-described  model,  they  were 
more  fully  developed,  particularly  in  the  direction  of  obtaining  variances 
and  covariances  of  the  estimates  and,  preparing  tables  for  the  first  named 
model,  which  will  greatly  assist  the  task  of  solving  a difficult  equation. 

The  second  model  results  in  equations  which  are  not  solvable  in  advance,  since 
as  seen  in  Section  V,  they  are  based  on  polynomials  with  random  numbers 
as  coefficients. 

The  third  model  also  developed  by  Moranda  [14]  has  applicability  to  the 
process  of  estimation  of  the  number  of  execution  sequences.  This  model, 
described  In  Section  V,  while  decreasing  the  rate  In  a geometric  progression 
has  a constant  rate  which  represents  the  long  term  or  asymptotic  detection 
rate.  That  model  while  having  applicability  In  describing  the  transition 
between  the  "burn-in"  and  steady  state  phases  as  defined  in  hardware 
reliability  studies,  has  applicability  to  software  which  is  used  in 
programs  controlling  equipment,  and  which  consequently  derive  some  of  their 
input  from  sensors  of  the  ambient  conditions. 

In  more  extensive  use  of  the  above  described  techniques.  It  is  well  to  set 
up  separate  tests  for  each  combination  of  Input  parameters.  For  example, 
the  degree  of  the  polynomial  Is  known  to  have  an  pronounced  effect 
on  the  execution  sequences  which  are  realized.  That  has  been  noted  in 
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the  above  (all  quadratics  exercised  but  12  segments).  For  the  program  which 
is  tested  here,  a good  analysis  would  involve  estimating  the  execution 
sequences  for  each  degree,  from  zero  (constant),  to  at  least  80  . (Instruction 
4-5  makes  a test  on  the  degree  against  an  upper  limit  of  79). 

4.  Constructed  Cases  (ZPOLYR) 

The  following  PTT-segments  were  not  exercised  by  any  of  the  preceding 
described  runs: 


2 

4 

14 

16 

21 

21 

24 

25 

27 

28 

29 

30 

39 

41 

42 

44 

45 

48 

53 

92 

94 

109 

111 

130 

132 

Because  of  the  extensive  comnents  in  the  listing  of  the  program,  it  is  quite 
easy  to  construct  cases  which  exercise  many  of  these  still  undriven  segments. 

a.  Segment  Analysis 

For  a polynomial  of  degree  80,  PTT-segment  No.  2 (denoted  here)  is  exercised, 
while  it  is  not  for  any  smaller  degree.  This  or  any  larger  degree  causes 
the  execution  sequence  Z2,  Z^,  Z^g.  Of  these,  Z^4Q  is  exercised  by  any  error 
message  and  it  has  been  exercised  before.  Thus,  the  limitation  on  the 
degree  causes  two  new  segments  to  be  exercised.) 

A polynomial  of  1st  or  0th  degree  will  cause  the  execution  sequence  Zj,  Z3,  Z5, 
Z6*  Z9 ’ Z35*  Z37*  Z4Q»  zi39*  a11  of  wh1ch  are  exercised  in  at  least  one 
prior  case  (if  the  quadratic  had  been  considered  after  this  construction, 

Zg  and  others  would  not  have  been  exercised. 

Segment  Z14  can  be  exercised  by  entering  a string  of  zeros  for  input.  This 
segment  then  leads  Into  formerly  exercised  segments. 

Segment  Z16  can  be  exercised  by  entering  coefficients  which  exceed  a 
programmer-specified  parameter,  which  in  the  cases  employed  had  the  value 
101  . This  did  not  and  could  not  occur  with  the  "picking"  function  used. 

It  can  be  by  choosing  2-  N -12  and  any  coefficient  in  excess  of  10 
Alternatively,  the  parameter  can  be  assigned  a smaller  value. 
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Segments  , Z 23>  and  Z 24  are  inexorably  linked  and  can  be  exercised  by  back- 
working  from  the  condition  ABS  (SNGL  (DU ( I ) ) < BIT),  where  BIT  is  set  to  be 
the  smallest  positive  number  in  the  machine.  This  condition  can  be  met  by 
setting  the  leading  coefficients  of  the  polynomial  equal  to  zero.  The  impli- 
cation to  the  program  user  is  that  an  infinite  zero  is  found  (an  error 
message  would  have  done  as  well  for  ordinary  problems,  but  since  ZPOLYR  is 
a callable  subroutine  it  is  useful  to  have  this  capability). 

Segments  Z25,  Z^,  Z2g,  Z29  and  Z3Q  are  linked  and  are  dependent  on  a condition 

met  by  the  occurrence  of  zero  for  at  least  two  leading  coefficients  (i.e.,  the 
n n 1 

coefficients  of  z and  zn“  are  zero).  This  will  occur  with  very  low 
probability  (the  product  of  two  very  small  values)  when  random  numbers  are  used. 

Segments  Z^g,  Z^g,  and  Z^  are  linked  and  dependent  on  the  occurrence  of  an 
error  or  anomaly  in  a called  subroutine  (ZQUADR).  Insofar  as  this  routine 
is  concerned,  these  segments  should  not  be  counted  as  relevant. 

Segment  Z42,  Z^,  and  Z^5  are  linked  and  depend  on  the  constant  term  of  the 
input  (or  derived  polynomial)  being  zero.  With  random  number  generators  used 
to  pick  coefficients,  this  is  unlikely  and  Indeed  it  did  not  occur.  Entry 
of  a 4th  degree  polynomial  with  a zero  for  the  constant  would  exercise  Z42* 

Z44  and  Z45. 

Segment  Z4Q  requires  simultaneous  (logical  AND)  satisfaction  of  a predicate 
which  states  that  the  original  polynomial,  or  a "working"  polynomial  derived 
from  It  by  quadratic  factoring,  has  the  (N-2)nd  and  (N-l)st  coefficients  equal 
to  zero.  This  can  be  met  most  easily  by  choice  (and  not  "easily"  by  random 
selection) . 

Segment  Zg3  requires  three  (logical  AND)  conditions  to  be  satisfied: 

(a)  The  degree  of  the  polynomial  must  be  even. 

(b)  The  product  of  the  signs  of  the  coefficients  of  the  lowest  and 
highest  degree  terms  in  a reduced  polynomial  must  be  positive. 

(c)  The  occurrence  of  zero  for  the  leading  coefficients  of  a 
polynomial  when  returning  from  a subroutine  (ZQUADR). 


76 


This  segment  had  no  realized  predecessor  for  all  but  one  case;  that  is  to  say, 

the  lead-in  path  to  the  segment  was  blocked  except  for  one  case.  In  that 

one  case  there  was  an  overflow  in  the  program  and  the  real  part  of  the 

1 51 

first  root  extracted  had  a magnitude  of  10  . This  probably  caused  the 

deflated  polynomial,  obtained  by  extracting  a linear  or  quadratic  factor 
out  of  the  original  polynomial,  to  appear  to  have  zero  leading  coefficient 
and  the  test  conditions  (c)  was  met.  However,  the  product  of  signs 
in  the  original  polynomial  (and  probably  in  the  deflated  polynomial), 
in  that  case  was  negative.  This  path  can  be  exercised  by  random  numbers 
but  was  not. 


Zg2  and  Zg4  are  linked  and  depend  on  an  error  occurring  in  the  subroutine 
ZQUADR.  This  did  not  occur  at  that  point  in  the  program.  These  segments 
should  not  be  considered  relevant  to  the  ZPOLYR  subroutine. 

Zlog  and  Z^  are  exactly  the  same  as  the  preceding  pair:  they  depend  on  an 

error- fn  ZQUADR.  -These  too  should  not  be  considered  as  relevant. 

Z^Q  and  Z^  are  linked  and  depend  on  a zero  value  for  the  imaginary  part 
of  a coefficient  of  a working  polynomial.  This  is  not  likely  to  occur  in 
random  tests. 


Z^38  depends  on  an  error  occurring  in  ZQUADR  and  is  not  relevant. 


From  the  above,  a categorization  can  be  made.  First,  those  that  test  for 
acceptable  data: 

Z2*  Z4*  Z16 

Second,  there  are  those  that  are  zero  test  dependent: 

Z14*  Z25*  Z27’  Z28*  Z29’  Z30’  Z42*  Z44*  Z45’ 

Z48*  Z1 30  * Z1 32 

Third,  there  are  segments  which  are  irrelevant  in  that  they  depend  on  the 
occurrence  of  an  error  In  a called  subroutine: 

Z3*  Z39’  Z41 * Z92*  Z94*  Z109’  Zlll’  Z138 
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Finally,  Z53*  stands  apart  and  requires  satisfaction  of  three  conditions.  It 
can  conceivably  be  exercised  by  random  data. 

The  number  of  exercisable  segments  by  random  data  then  can  be  considered  to 
number  131 . 

5.  Rationale  for  Test  Case  Selection  (ZPOLYR) 

The  difficulties  which  occur  in  the  preceding  described  program  can  or  could 
be  alleviated  in  several  ways. 

First,  as  a general  conment,  It  is  clear  that  a systematic  case  selection 
which  consists  in  stepping  through  the  degree  of  the  input  polynomial  would 
accomplish  the  testing  of  those  branches  which  are  degree  dependent. 

The  same  or  similar  remark  would  apply  to  other  input  parameters,  which  are 
actually  programmer  options,  but  which  in  most  cases  are  not  generally  changed 
from  the  built-in  values  which  are  provided  when  no  choice  is  made  by  the  user. 
Varying  these  would  provide  a more  exhaustive  level  of  testing  even  though 
the  computational  results  may  be  inaccurate,  or  intermediate  results  may 
cause  premature  or  unnecessary  overflows. 

For  a fixed  degree  and  a fixed  set  of  input  parameters  (as  distinct  from  input 
data)  the  results  which  have  been  obtained  are  more  than  satisfactory:  random 

cases  in  small  sample  sizes  generally  exercise  all  but  the  overflow  and  zero- 
tests  for  program  variables.  This  cannot  be  compared  with  other  options 
until  a standard  set  of  input  cases  Is  specified.  But  it  is  clear  that  the 
cases  used  comprise  a more  extensive  testing  level  than  "ordinarily"  is 
achieved.  Ordinarily  the  test  cases  are  made  by  forming  simple  integer- 
coefficient  polynomial  and  generally  with  ratios  of  max  to  min  which  are 
small  while  In  the  random  testing  these  ratios  can  (and  did)  achieve  values 
of  nearly  10Z®. 

In  order  to  supply  a more  exhaustive  test  and  to  accomplish  a hybrid  random/ 
constructed  case  selection,  a sequence  of  polynomials  can  be  formed  in  which 
the  value  zero  Is  provided  as  a part  of  the  domain  from  which  the  random  numbers 
are  chosen.  As  noted  before,  the  random  testing  employed  in  the  illustrated 
cases  could  not  pick  zero  values,  and  even  if  zero  were  in  the  range  of 
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possible  values  it  would  be  selected  with  essentially  zero  probability.  This 
fact,  coupled  with  the  realization  that  the  particular  nature  of  the  distri- 
bution has  no  real  relevance  to  exhaustive  testing,  make  this  option  very 
appealing.  The  probability  split  between  non-zero  and  zero  input  cases 
is  (again)  arbitrary  but  if  the  split  is  too  much  biased  against  zeros, 
the  occurrence  of  multiple  zeros  such  as  are  required  for  certain  program 
branches,  would  not  occur  often  in  reasonable  sized  samples.  A split  of 
8 to  1 seems  reasonable  for  input  samples  of  reasonable  size. 

C . Curvature  Program 

Because  of  the  large  non-stochastic  portion  of  the  testing  i n the  polynomial- 
root-solver  programs  which  were  discussed  above,  a library  search  for  programs 
which  were  less-dependent  on  program  parameters  was  made.  The  following 
described  program  is  seemingly  ideal  in  this  respect. 

1.  Description  of  Program  CURVTR 

The  program  selected  computes  the  curvature,  and  the  direction  cosines  of 
the  normal,  at  a point  or  a surface  defined  over  the  unit  square  (using 
variables  u and  w as  the  Independent  variables,  this  is  the  region  0<u<l  and 
0<w<l ) . 

Each  coordinate  of  the  surface  is  represented  by  a bi -cubic  in  the  variables 
u and  w.  Thus  the  x-component  is 
3 3 

X(UV.)  * l l A.,uV 
1*0  j=0  J 

and  similarly  for  the  y and  z coordinates  of  a surface  point.  The  program 
employs  the  notation  v,  for  the  point  with  components  x,y,  and  z.  There 
are  altogether  48  coefficients  for  the  three  coordinates.  The  so-defined 
surface  Is  unique  and  unambiguous. 

Required  for  the  curvature  and  direction  cosines  are  the  first  and  second 

partial  derivatives  with  respect  to  the  parameters  u and  v and  these  are 

determined  by  simple  formulas.  For  example, 

3 3 

<$x(u,v)  * l l lA^V'V. 

6U  j*0  j=0  J 
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Essentially  all  of  the  computations  are  formula  evaluations  with  a pair  of 
assigned  values  to  u and  w. 


*1 


2.  CURVTR  Listing 

The  listing  of  this  program  is  shown  in  the  following  pages,  as  Figure  11. 


3.  Random  Testing  of  CURVTR 

Processing  of  this  program  by  the  PTS  system  established  that  there  are  56  PTS- 
segments. 


After  the  set  of  PTS-segments  are  linked  together  to  form  segments  as  previously 
defined,  they  were  found  to  number  36.  These  can  be  represented  as  a directed 
graph  as  shown  in  Figure  12. 

As  noted  in  previous  discussions,  the  number  of  possible  paths  through  a 
system  may  be  fairly  large.  But  as  also  mentioned  before,  it  has  been 
found  "experimentally"  that  many  of  the  potential  paths  are  not  realizable. 

To  this  point,  in  Figure  13,  there  is  shown  the  result  of  using  20  cases 
consisting  of  coefficients  (48)  chosen  from  a e-distribution  on  the 
logarithm  and  positions  chosen  by  a e-distribution  on  each  coordinate 
in  the  unit  square.  This  result  is  interesting  in  at  least  two  respects. 

First,  the  paths  shown  account  for  only  10  out  of  31  of  the  segments.  But, 
more  importantly,  the  response  Is  perfectly  consistent:  every  one  of  the 

20  random  test  cases  which  were  used,  exercised  all  three  of  the  branches  num- 
bered 8,  9,  and  10  of  Figure  13.  Thus  the  randomly  selected  cases  exhibited 
a remarkable  consistency. 

Although  20  is  a small  sample  size  it  should  be  stated  that  in  separate 
runs,  distributions  other  than  the  e were  employed  and  identical  results 
were  obtained.  In  a certain  sense,  this  rather  simple  program  has  been 
exhaustively  tested  by  just  one  sample.  The  sense,  of  course,  is  that  all 
the  branches  ever  executed  by  random  selection  is  accomplished  on  the  first 
"draw". 

The  algorithm  employed  so  successfully  before  is  of  no  value  in  estimating  the 
number  of  execution  sequences.  An  alternative  is  mentioned  below. 
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SUBROUTINE  CURVTR  ( V,U,W,CV,DC  ) 

C THIS  ROUTINE  WILL  FIND  THE  CURVATURES  OF  A LINE  DEFINED  BY  THE 
C INTERSECTION  OF  EACH  OF  THE  THREE  ORTHOGONAL  PLANES  WITH  THE 
C PATCH  (V)  AT  THE  POINT  (U,W),  DIRECTION  COSINES  OF  THE 
C SURFACE  NORMALS  AT  THAT  POINT  ARE  PLACED  IN  (DC). 

CAUTION  - THIS  ROUTINE  WILL  NOT  COMPUTE  CURVATURE  AT  THE  DEGENERATE 
C EDGE  OF  A PATCH 

C ARGUMENT  DESCRIPTION 

C V ( 1 6 ,3 ) INPUT,  PATCH  COEFFICIENTS  IN  ALGEBRAIC  FORM 


U INPUT, 

W INPUT, 

CV(1)  OUTPUT, 
CV(2)  OUTPUT, 
CV(3)  OUTPUT, 
DC ( 1 ) OUTPUT, 
DC  2)  OUTPUT, 
DC (3)  OUTPUT, 
SUBROUTINES  CALLED: 


INPUT,  PARAMETRIC  VARIABLE  U 
INPUT,  PARAMETRIC  VARIABLE  W 

OUTPUT,  CURVATURE  IN  Y-Z  PLANE 

OUTPUT,  CURVATURE  IN  X-Z  PLANE 

OUTPUT,  CURVATURE  IN  X-Y  PLANE 

OUTPUT,  X DIRECTION  COSINE 
OUTPUT,  Y DIRECTION  COSINE 
OUTPUT,  Z DIRECTION  COSINE 
CALLED:  PLACE 


CURVOOIO 
CURV0020 
CURV0030 
CURV0040 
CURV0050 
CURV0060 
CURV0070 
CURV0080 
CURV0090 
CURVOIOO 
CURVOl 10 
CURV0120 
CURV0130 
CURVOl 40 
CURVOl 50 
CURVOl 60 
CURVOl 70 
CURVOl 80 


DIMENSION  B ( 1 6 ) , C (3 ) ,CV (3 ) , DC (3 ) , V ( 1 6 ,3 ) ,VU(3) ,VW(3) ,VUU(3) ,VWW(3)CURV0200 
1 ,VUW(3) ,A1 (3,2) ,A2(3 ,2)  CURV0210 
EQUIVALENCE  (VU(1 ) ,A1 (1 ,1 ) ) ,(VW(1 ) ,A1 (1 ,2) ) ,(VUU(1 ) ,A2(1 ,1 ) ) , CURV0220 
1 (VWW(1 ) ,A2(1 ,2))  CURV0230 
U3  = 3 . 00*U  CURV0240 
U6  = U3  + U3  CURV0250 
W3  = 3 . 00*W  CURV0260 
W6  = W3  + W3  CURV0270 
DO  10  I = 1,3  CURV0280 
CALL  PLACE  ( V(1,I),B,0  ) CURV0290 
B2  = B(2)  + B(2)  CURV0300 
B6  = B(6)  + B(6)  CURV0310 
BIO  = B ( 1 0)  + B(10)  CURV0320 
B14  = B(14)  + B ( 1 4 ) CURV0330 
VUW(I)  = ( (B ( 1 )*U3+B2)*U+B(3) )*W3*W*((B(5)*U3+B6)*U+B(7))*(W+W)  CURV0340 
1 +(B(9)*U3+B10)*U+B(11)  CURV0350 
VUU ( I ) = ( ( ( B ( 1 ) *U6+B2 ) *W+B ( 5 ) *U6+B6 ) *W+B  ( 9 ) *U6+B 1 0 ) *W+B ( 1 3 ) *B6+B1 4 CURV0360 
VU(I)  = ((((B(1)*U3+B2)*U+B(3))*W+(B(5)*U3+B6)*U+B(7))*W+(B(9)*U3  CURV0370 
l*B10)*U+B(ll))*W+(B(13)*U3+B14)*U+B(15)  CURV0380 
B2  * B(5)  + B ( 5)  CURV0390 
BIO  * B(7)  + B(7)  CURV0400 
B14  * B(8)  + B(8)  CURV0410 
VWW ( I ) = ( ( ( B ( 1 ) *W6+B2 ) *U+B ( 2 ) *W6+B6 ) *U+B ( 3 ) *W6+B 1 0 ) *U  B ( 4 ) *W6+B 14  CUR V0420 
VW(I)  = ((((B(l)*W3+B2)*W+B(9))*U+(B(2)*W3+B6)*W+B(lff))*U+(B(3)*  CURV0430 
IW3+B10)*W+B(11))*U+(B(4)*W3+B14)*W+B(12)  CURV0440 
CONTINUE  CURV0450 


VUU (I)=(((B(1) *U6+B2 ) *W+B ( 5 ) *U6+B6 ) *W+B ( 9 ) *U6+B 1 0 ) *W+B (13) *B6+B 1 4 
VU(I)  = ({((6(1) *U3+B2 ) *U+B (3 ) ) *W+ (B ( 5 ) *U3+B6 ) *U+B ( 7 ) ) *W+ (B ( 9 ) *U3 
1*B10)*U+B(1 1 ) )*W+(B(13)*U3+B14)*U+B(15) 

B2  = B(5)  + B ( 5 ) 

BIO  * B(7)  + B(7) 

B14  = B(8)  + B (8) 

VWW(I)=(((B(1)*W6+B2)*U+B(2)*W6+B6)*U+B(3)*W6+B10)*U  B(4)*W6+B14 
VW(I)  = C(((B(1 )*W3+B2)*W+B(9) )*U+(B(2)*W3+B6)*W+B(lU))*U+(B(3)* 
1W3+B10)*W+B(1 1 ))*U+(B(4)*W3+B14)*W+B(12) 


10  CONTINUE 


*VU(1 

*VW(1 


1)  + VU (2)*VU (2)  + VU(3)*VU(3) 
1)  + VU(2)*VW(2)  + VU(3)*VW(3) 
1 + VW(2)*VW(2)  +VW(3)*VW(3) 

1 )*B(3)  - B(2)*B(2)  ) 


U3  = 1.00  / ( B(1)*B(3)  - B(2)*B(2)  ) 

U6  - SQRT  ( U3  ) 

B(4)  * U6*(  VU(2)*VW(3)  - VU(3)*VW(2)  ) 

B(5)  = U6*(  VU(3  *VW  1 - VU  1 *VW  3 

B 6 * U6*(  VU(1)*VW(2)  - VU(2)*VW(1 ) ) 

B ( 7 ) * VUU  1)*B(4)  + VUU(2)*B(5)  + VUU  3)*B(6) 

B 8 * VUW  1 *B(4)  + VUW(2  *B(5  + VUW(3  *B(6 

B(9)  * VWW(1)*B(4)  + VWW(2)*B(5)  + VWW(3)*B(6) 

Figure  11.  Listing  of  CURVTR  Subroutine  (Page  1 of  3) 
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DO  70  I = 1,3 

CURV0570 

31 

I 

CV(I)  = 0.00 

CURV0580 

1 

B( 1+9)  = U3*(  B(3)*VU(I)  - B ( 2 ) *VW ( I ) ) 

CURV0590 

1 

B( 1+12)  = U3*(  B ( 1 ) *VW ( I ) - B ( 2 ) *VU ( I ) ) 

CURV0600 

IF  ( ABS ( B( 1+3)  ) ,LT,  .99999D0  ) GO  TO  70 

CURV0610 

35 

36 

1 

J = 0 

CURV0620 

| 

' IF  ( B ( 7 ) .NE.  0.00)  GO  TO  20 

CURV0640 

38 

39 

J = 1 

CURV0640 

B ( 1 6 ) = 1.00  / ( B(1 )*  SQRT(  B(l)  ) ) 

CURV0650 

41 

1 

GO  TO  30 

CURV0660 

1 

20  IF  ( B(9)  .NE.  0.00  ) GO  TO  70 

CURV0670 

43 

44 

J = 2 

CURV0680 

1 

B ( 1 6 ) = 1.00  / ( B(3)*  SQRT(  B(3)  ) ) 

CURV0690 

46 

1 

30  IF  ( I - 2 ) 40  , 50  , 60 

CURV0700 

40  CV(1)  = ( A1 (3,J)*A2(2,J)  = A1  (2,J)*A2(3,J)  )*B(16) 

CURV0710 

1 

GO  TO  70 

CURV0720 

1 

50  CV(2)  = ( A1(3,J)*A2(1,J)  = A1  (1  ,J)*A2(3,J)  )*B(16) 

CURV0730 

GO  TO  70 

CURV0740 

51 

60  CV(3)  = ( A1 (2,J)*A2(1 ,J)  = A1 (1 ,J)*A2(2,J)  )*B(16) 

CURV0750 

1 

70  CONTINUE 

CURV0760 

I 

DO  170  1-1,3 

CURV0770 

W6  = B ( 1+3 ) 

CURV0780 

I 

B ( 1+3 ) = 0.00 

CURV0790 

56 

\ 

U6  = B(4)*B(4)  + B(5)*B(5)  + B(6)*B(6) 

CURV0800 

\ 

VUW(I)  = SQRT(  U6  ) 

CURV0810 

n 

B ( 1+3 ) = W6 

CURV0820 

( 

IF  ( U6  .EQ.  0.00  ) GO  TO  110 

CURV0830 

60 

61 

C(I)  = 0.00 

CURV0840 

i IF  ( I * 2 ) 80  , 90  , 100 

CURV0850 

1 

80  C(2)  = -B(6) 

CURV0860 

j 

C(3)  = B ( 5) 

CURV0870 

GO  TO  150 

CURV0880 

66 

i 

90  C(l)  = B ( 6 ) 

CURV0890 

I 

C(3)  = -B(4) 

CURV0900 

GO  TO  150 

CURV0910 

m 

100  C(l)  = -B(5) 

CURV0920 

C ( 2 ) = B(4) 

CURV0930 

71 

1 

GO  TO  150 

CURV0940 

110  U3  = 1.00 

CURV0950 

| 

W3  = 1.00 

CURV0960 

I 

IF  ( VW(I)  .EQ,  0.00  ) GO  TO  120 

CURV0970 

75 

76 

W3  = -VU(I)  / VW(I) 

CURV0980 

i 

GO  TO  140 

CURV0990 

1 

120  IF  ( VU(I)  .EQ,  0.00  ) GO  TO  130 

CURV1000 

79 

80 

f U3  = 0.00 

CURV1010 

81 

GO  TO  140 

CURV1020 

| 

i 130  IF  ( ABS ( VU ( 1 ) )+  ABS(VU(2) )+  ABS(VU(3) ) .EQ,  0.00  ) GO  TO  140 

CURV1030 

83 

84 

1 

W3  = 0.00 

CURV1040 

140  C(l)  » U3*VU(1 ) + W3*VW(1 ) 

CURV1050 

86 

j 

C(2)  * U3*VU(2)  + W3*VW(2) 

CURV1060 

1 

C(3)  = U3*VU(3)  + W3*VW  3 

CURV1070 

U6  = C(1)*C(1)  + C(2)*C(2)  + C(3)*C(3) 

CURV1080 

-j 

IF  ( U6  .EQ.  0.00  ) GO  TO  160 

CURV1090 

90 

91 

1 

150  U6  = 1.00  / SQRT ( U6  ) 

CURV1100 

160  C(l)  » C ( 1 ) *U6 

CURV1110 

C(2)  = C(2)*U6 

CURV1120 

i 

Figure  11.  Listing  of  CURVTR  Subroutine  (Page  2 of  3) 

1 

62 

1 

C ( 3 ) = C(3)*U6 

VUU(I)  = C(1 )*B(10)  + C ( 2 ) *B (11)  + C(3)*B(12) 
VWW(I)  = C(1)*B(13)  + C(2)*B(14)  + C(3)*B(15) 
170  CONTINUE 

DO  190  I = 1,3 
DC ( I ) = B( 1+3) 

IF  ( CV(I)  .NE.  0.00  ) GO  TO  190 
IF  ( ABS ( VUU(I)  ) .LT.  .IE-30  ) VUU(I)  = 0.00 
IF  ( ABS(  VWW(I)  ) .LT.  .IE-30  ) VWW(I)  = 0.00 
VU(1)  = VUU(I)*VUU(I) 

VU ( 2 ) = ( VUU(I)*VWW(I)  ) + ( VUU(I)*VWW(I)  ) 
VU(3)  = VWW(I)*VWW(I) 

VW(I)  = B ( 7 ) *VU ( 1 ) + B(8)*VU(2)  + B(9)*VU(3) 

IF  ( VUW(I)  .EQ.  0.00  ) GO  TO  180 
Cr(I)  = VW(I)  / VUW(I) 

GO  TO  190 
180  CV(I)  = 1.E40 
190  CONTINUE 
RETURN 
END 


CURV1130 
CURV1 140  96 

CURV1 1 50 
CURV1 1 60 
CURV1170 
CURV1180 

CURV1 1 90  101  102 

CURV1200  103  104 

CURV1210  105  106 

CURV1220 

CURV1230 

CURV1240 

CURV1250 

CURV1260  111  112 

CURV1270 

CURV1280 

CURV1300 

CURV1300 

CURV1310 

CURV1320 


Figure  11.  Listing  of  CURVTR  Subroutine  (Page  3 of  3) 


4.  Testing  by  Constructed  Cases 

Without  discussing  in  detail  the  method  of  constructing  the  special  test 
cases,  it  is  noted  that  the  sequencing  of  the  cases  was  done  in  the  most  natural 
way,  that  is,  by  "painting"  through  the  program  to  the  first  untested 
branch,  inventing  a way  of  testing  it,  examining  the  result  of  the  test  case, 
retracing  through  to  the  next  untested  case,  and  so  forth. 

The  first  constructed  test  case,  which  was  designed  to  exercise  segment  number 
3,  also  exercised  segments  5,  7,  12,  19,  20,  and  21  (as  well  as  25,  27,  29,  and 
31  which  were  also  exercised  by  the  random  cases).  This  is  shown  in  Figure  14. 
The  test  designed  to  drive  segment  4,  also  drove  10,  11,  14,  16,  17,  23,  25, 

26,  23  and  30  (as  well  as  19  and  20).  This  is  shown  in  Figure  15. 

After  obvious  permutations  of  variables  and  four  well  designed  cases  all  of 
the  segments  were  tested  except  segments  13  and  27.  It  can  be  shown  that 
segment  13  cannot  be  exercised  by  input  data  (the  condition  which  is  necessary 
cannot  exist  at  this  level  of  the  program).  It  is  unknown  (and  not  worth 
the  effort  to  establish)  whether  or  not  segment  27  can  be  driven  by  data, 
but  is  is  safe  to  say  that  it  will  only  be  driven  by  data  on  a knife-edge. 

In  the  construction  of  the  test  cases  the  conditions  which  had  to  be  met 
were  very  severe*,  and  it  is  doubted  that  the  protection  afforded  by  the 
programming  was  worth  its  direct  cost  (labor  of  the  programmer  ) or  the 
indirect  cost  (a  "crash"  due  to  its  absence).  Obviously  each  program  requires 
a separate  judgement  in  this  respect. 

5.  Number  Test  Cases  Required 

In  the  sample  problem,  a total  of  31  segments  are  shown  and  this  is  an  upper 
bound  for  the  number  of  test  cases  if  segment  level  testing  is  required. 

Because  of  the  particular  nature  of  the  sample  program,  "closing"  as  it 
does  at  two  nodes  between  the  start  and  end  nodes,  a sharper  upper  bound 
can  be  obtained. 

♦one  test  branch  requires  a direction  cosine  greater  than  .99999  (instruction 
0610). 
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Inspection  shows  that  the  bottom  cluster  can  be  exercised  completely  by  at 
most  5 test  cases.  Any  path  from  the  top  node  in  the  bottom  cluster  starting 
with  25  will  drive  three  more  segments.  There  are  then  only  four  other 
segments  to  drive  (in  actuality  it  was  found  that  3 cases  covered  all  of  the 
segments  in  the  bottom  cluster).  A generous  upper  bound  to  the  cases 
required  to  the  coverage  (at  the  segment  level  testing)  of  both  the  middle 
and  bottom  clusters  can  be  found  by  adding  to  those  segments  in  the  middle 
cluster  which  were  driven  in  covering  the  segments  in  the  bottom  cluster 
(and  are  therefore  already  covered  and  not  to  be  doubly  counted),  those 
segments  still  uncovered.  In  the  specific  example  this  turns  out  to  be  3, 
but  in  the  general  case  where  no  other  information  would  be  available,  it 
would  only  be  possible  to  assume  that  one  of  the  middle  branches  were  used, 
so  that  the  number  which  might  be  used  - this  would  assume  that  all  of  the 
segments  driven  in  the  bottom  cluster  can  be  driven  by  data  which  drives  the 
same  branch  in  the  middle  cluster  - would  be  one  less  than  the  number  of 
segments  in  the  middle  branch  minus  the  number  of  segments  in  the  shortest 
branch  in  the  middle  cluster.  This  (pessimistic)  estimate  in  the  sample 
program  would  be  10.  But  once  data  has  been  used  and  the  segments  in  the 
bottom  cluster  are  driven,  it  turns  out  that  there  are  only  three  segments 
in  the  middle  left  uncovered.  It  also  turns  out  that  all  of  the  segments 
in  the  top  cluster  are  exercised  when  the  bottom  two  clusters,  are,  but 
without  the  knowledge  so  obtained,  it  would  be  necessary  to  use  the  total 
count  10  (or  9 since  segment  1 is  always  driven),  since  the  shortest 
branch  is  of  length  1. 

Thus  a generous  upper  limit  for  the  test  cases,  in  the  absence  of  any 
other  knowledge  would  be  (in  this  special  kind  of  case),  25.  On  the  other 
hand  if  the  estimate  were  sequentially  formed  on  the  basis  of  the  results 
obtained  by  the  constructed  cases,  they  would  be  21,  10,  6,  5,  5 (a  fast 
converging  sequence). 
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V.  DEVELOPMENT  OF  DETECTION  RATE  MODELS 


A.  The  De-Eutrophication  Process 

This  model  is  described  in  an  overview  manner  in  Section  III. 

The  data  for  analysis  consist  of  the  sequence  of  times  between  errors: 

X-| , X2,...,Xn,  as  shown  in  Figure  4 (Section  III). 

1.  Maximum  Likelihood  Estimates  of  Parameters 
Estimation  of  the  parameters  N and  0 can  be  made  by  application  of  the 
maximum  likelihood  principle.  Under  the  assumption  that  there  is  a uniform 
failure  rate  between  errors,  the  density  for  X.  is  given  by 

p(Xi ) - 0[N-(1-1)]  exp{-  0[N-(i-l)]X.|  (13) 

and  the  likelihood  function  Is 

L(XrX2,...,Xn)  = I 0[N-(i-l )]  exp  j-rtN-O-niX^  (14) 


It  is  more  convenient  to  maximize  the  natural  logarithm  of  the  likelihood: 


loge  L * J log[N-(1-l)]0 
* | ^ log[N-(1-l )]  + 


Taking  partials  and  setting  to  zero 
n n 


- I [N-(i-l)]0X. 

1-1  1 

n log  0 - J [N- ( 1 -1 )]0X . 

1=1  1 


(15) 

(15a) 


3 log  L 


alog  L 

30 


ii  - y 

M W 

n - I (N-(1-l))Xi 

? 1=1  m 


0Xi 
= 0 


0 


(16) 

(17) 
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Letting  £X.  = T,  Eq.  17  can  be  solved  for  i>  to  yield 
t = n 

and  Eq.  16  becomes 


l , 

i=l  rN-(i-l) 


nT - n 

NT  1 (1-1)*,  n - | 


09) 


Equation  19  is  free  of  i and  presents  the  key  equation  to  solve.  The  two  data- 
derived  statistics  are  T = ^Xi  and  7 ( i -1  )X^ . Knowing  these  we  can  solve 
Eq.  19  for  N,  the  initial  error  content. 


Solving  this  for  N,  and  calling  the  result  N,  we  can  obtain  the  estimate 
for 

= , n (20) 

NT  - I(i-l)Xi 

The  preceding  development  is  essentially  a mathematical  exercise  and  does 
not  explicitly  employ  properties  of  the  Poisson  process;  accordingly,  the 
following  heuristic  argument  is  given  for  the  genesis  of  Eqs.  (16)  and  (17). 


The  mean,  or  expected  value,  of  a random  variable  having  an  exponential 
-Xx  -1 

distribution,  Xe  , is  equal  to  X and  in  the  particular  terminology 
of  the  Poisson  process,  this  is  called  the  mean-time-between-fai lures.  Thus, 
a reasonable  "representative"  for  the  variable  X^,  whose  distribution  is 
exponential  with  parameter  N4,  is  1 ; similarly  the  quantity  1 "represents" 

Xg.  and  so  forth.  Thus  summing  ovl?  the  n variables,  there  results 

n n 

y x,  - y i 

1-1  1 1-1  I TPfTTO 

Wilch  Is  essentially  Eq.  16.  With  the  expectation  operator  applied  to  the 
sum  this  equation  would  be  precise. 

For  a Poisson  process  with  a uniform  failure  rate,  e,  a reasonable  estimate  for 
e would  be  the  ratio  formed  by  dividing  the  number  of  failures  observed 
by  the  time  of  observation.  Another  way  of  looking  at  this,  and  a way  which 
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permits  generalization,  is  to  estimate  the  number  of  failures  occurring  in  a 
given  period  by  integrating  the  (constant)  failure  rate  over  that  period. 

This  same  procedure  will  apply  to  a variable  failure  rate,  and  in  the 
particular  process  of  the  model,  the  integration  becomes  very  simple. 

Performing  the  integration  and  setting  it  equal  to  n produces  the  equation 

n = N^X1  + (N-l ) <iX2  + ...  + (N-(n-l))rfXn 

or 

n = l (N-(i-l))X. 

(4  1 = 1 1 

which  is  seen  to  be  the  same  as  Eq.  17. 

a.  Estimate  of  MTTF 

From  general  considerations,  an  estimate  for  other  functions  of  the  two  variables 
N and  t can  be  obtained  by  substitution  of  their  estimated  value  into  the 
functional  relation. 

In  particular,  the  estimate  of  the  MTTF  can  be  obtained  by  taking  the  reciprocal 
of  the  failure  rate  at  the  end  of  the  observation  period.  In  the  present 
instance,  the  next  error  is  the  (n+l)st  error  and  the  estimate  for  the 
MTTF  is 

M,  - [N-n]0  1 (21) 

where  we  have  used  a subscript  to  distinguish  between  the  estimates  which 
different  models  provide. 

b.  Estimate  of  Purification  Percentage 

For  comparison  purposes,  the  degree  of  purification  which  has  been  achieved 
through  testing  can  be  used.  It  is  simply  the  ratio  of  the  difference  between 
the  initial  and  final  failure  rate  and  the  initial  failure  rate.  In  the 
present  instance  this  is 

A A A A 

P,  = 100.  -w?.  Eft-Pi* = 100."  (22) 

1 N0  N 

where  we,  again,  use  a subscript  to  denote  the  model  associated  with  the 
estimate. 
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c.  Variances/Covariances  of  Estimates 

The  general  properties  of  maximum  likelihood  estimates  can  be  used  in  a purely 
formal  way  to  derive  some  measure  of  the  variability  in  the  estimates.  This 
point  must  be  emphasized  since  it  is  manifest  that  the  use  of  asymptotic 
formulas  (involving  large  sample  sizes)  on  samples  which  are  fundamentally 
limited  to  be  finite  (there  can  be  no  larger  samples  than  there  are  errors) 
can  result  only  in  caution-laden  approximations.  Nonetheless,  the  experiences 
which  have  been  gained  using  the  models  seem  to  indicate  that  these  approxi- 
mations for  the  variances  are  generally  much  too  large. 


The  basis  for  the  development  of  the  large  sample  estimates  is  a theorem 
due  to  R.  A.  Fisher  which  states  that  under  certain  "general  conditions", 
which  have  to  do  with  the  boundedness  of  the  first  three  derivatives  of 
the  likelihood,  the  variance  and  covariances  of  the  estimates  are  given 
by  the  inverse  of  a matrix  formed  from  the  mathematical  expectation  of 
second  partial  derivatives. 


Explicitly  the  matrix  A.,  (which  is  to  be  inverted)  employed  in  the  estimation 

* J 

of  several  parameters  (e^ .flg*. .. »®n)  has  the  terms 


-E 


32loqL  i 
3 e i 3 e j j 


(23) 


From  Eqs.  (16)  and  (17)  above 


32L  . 

5?  ' ' 

A . A_ 


1 


f=l  (N-i+1 y 
n 

- Li 


(24) 

(25) 


(26) 
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And  since 


1 

E(X . ) = 1 

1 '(N-1+1  )0 

II 

the  matrix  elements  become: 

- $ 

1 

n i 

a = y — - — 5— 

n 1=1  (N-i+l)2 

(27) 

•• 

L 

n -1 

A12  A21  I=1  (N-i+T)0 

(28) 

l 

( 

i 

i 

I 


(29) 


where  for  evaluation  in  practical  situations,  the  values  of  N and  0 (the 
estimates  based  on  the  data)  are  used.  The  determinant  (denoted  Det-j) 
of  the  A-matrix  is 


De^  — Aj  l^22~Al  2A21 


n ? 

l 1 . n - T2 

i=l  (N-1+1)2  ? 


(30) 


where  we  have  used  the  fact  that  "on  the  average" 


I 


1 


Hence 


y 

i=l  (N-i+l )0 

Var  (N) 

Var  (0) 


= T,  the  total  observation  time. 


n 

7 

n 


1 

Det 
1 


1 


r=l  N-i+l 


Covar  (N,0)  = - T 


Det, 


(31) 

(32) 

(33) 


De^ 

Since  for  a fixed  sample  size  n,  the  solutions  for  N and  0 by  means  of 
Eqs.  (18)  and  (19),  depend  only  on  the  ratio  R = £(1-1 )Xj  , so  also  can 
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the  variance  and  covariance  be  determined  from  R.  This  is  done  in  the 
subsequent  section. 


2.  Explanation  and  Development  of  Appendix  II 
The  solutions  to  the  maximum  likelihood  equations  and  the  subsequent 
computation  of  the  MTTF  and  other  derived  measures  are  difficult  to 
wring  out.  A material  assist  is  provided  by  the  tables  which  form 
Appendix  II. 


Since  for  a fixed  sample  size  n,  the  solutions  for  N and  i>  by  means  of 

Eqs.  18  and  19  depend  only  on  the  ratio  R = i(i-l )Xj  , it  is  possible 

Ek  \ 

to  tabulate  solutions  as  a function  of  the  ratio.  With  the  so-determined 
solutions,  the  (estimated)  variances  and  covariances,  and  the  MTTF  can  be 
obtained.  Such  a table  can  be  computed  for  each  integer  n. 

In  order  to  tabulate  the  parameters  for  an  arbitrary  realization  of  the 
process,  it  is  necessary  that  the  scale  for  time  be  normalized.  Since  the 
total  observation  time,  T,  is  assumed  recorded  by  the  data  collection 
process,  it  is  a natural  scale  factor  to  use.  It  must  be  pointed  out 
however,  that  this  time  is  a random  variable;  although  it  is  treated  as 
if  it  were  a constant,  this  is  a purely  pragmatic  interpretation.  A 
reasonable  interpretation  which  can  be  made  is  that  the  results  which  are 
recorded  are  conditional  on  the  observed  time. 

Given  the  ratio  R,  the  MLEs  become 


j.  1 = _n_ 

1=1  N-(i-l)  N-R 


Equation  (34)  can  be  solved  essentially  by  trial  and  error.  Once  N is 
established,  the  quantity  0T  can  be  obtained  from  Eq.  (35).  The  quality 
0T  is  entered  In  column  3 of  the  sample  table.  Table  XI. 

The  variance  of  N can  be  obtained  in  the  following  way. 
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Table  XI 
Sample  Table 
(n  = 26) 


Ratio 

Error 

Content 

(PHI)T 

DEVN 

DEV0 

(Normed) 

C0VAR 

(Normed) 

MTTF 

(Normed) 

14.0 

51.19 

.6991 

35.88 

.6883 

-24.2005 

.0568 

’4.2 

46.94 

.7942 

27.74 

.6907 

-18.6666 

.0601 

14.4 

43.62 

.8899 

22.04 

.6936 

-14.7968 

.0638 

14.6 

40.95 

.9866 

17.87 

.6966 

-11.9618 

.0678 

14.8 

38.78 

1.0842 

14.75 

.7001 

-9.8426 

.0722 

15.0 

36.98 

1.1826 

12.36 

.7041 

-8.2155 

.0770 

15.2 

35.47 

1.2824 

10.47 

.7083 

-6.9311 

.0823 

15.4 

34.19 

1.3836 

8.95 

.7129 

-5.9020 

.0882 

15.6 

33.10 

1.4857 

7.73 

.7181 

-5.0736 

.0948 

15.8 

32.15 

1.5898 

6.72 

.7235 

-4.3850 

.1022 

16.0 

31.34 

1.6953 

5.88 

.7296 

-3.8158 

.1105 

16.2 

30.62 

1 .8027 

5.17 

.7361 

-3.3350 

.1200 

16.4 

30.00 

1.9121 

4.56 

.7432 

-2.9274 

.1308 

16.6 

29.45 

2.0236 

4.05 

.7508 

-2.5795 

.1433 

16.8 

28.96 

2.1377 

3.60 

.7591 

-2.2784 

.1579 

17.0 

28.53 

2.2541 

3.21 

.7681 

-2.0185 

.1750 

17.2 

28.15 

2.3737 

2.87 

.7777 

-1.7909 

.1956 

17.4 

27.82 

2.4959 

2.58 

.7883 

-1.5935 

.2205 

17.6 

27.52 

2.6222 

2.32 

.7995 

-1.4173 

.2516 

17.8 

27.25 

2.7519 

2.08 

.8119 

-1.2630 

.2912 

18.0 

27.01 

2.8862 

1.87 

.8251 

-1.1250 

.3436 

18.2 

26.80 

3.0247 

1 .69 

.8396 

-1 .0035 

.4154 

18.4 

26.61 

3.1680 

1.52 

.8556 

-.8964 

.5200 

Column  1 is  the  ratio  j:(i -1  )X^  /eX^ 

Column  2 is  the  estimate  for  the  total  error  content 


Column  3 is  the  normed  estimate  for  step  size:  in  order  to  determine  the 

actual  estimate  of  the  step  size,  the  entry  in  this  column  should  be  divided 
by  the  total  observation  time  T. 

Column  4 is  the  approximate  standard  deviation  of  the  estimate  of  the  total 
error  content. 

Column  5 Is  the  normed  standard  deviation  of  the  estimate  of  the  step  size: 
in  order  to  botain  the  actual  standard  deviation  the  entry  in  this  column 
should  be  divided  by  the  total  time  T. 

' Column  6 is  the  normed  covariance  between  N and  d:  in  order  to  obtain  the 

actual  estimated  covariance  the  entry  should  be  divided  by  T. 

| Column  7 is  the  normed  MTTF  and  in  order  to  obtain  the  actual  value  the  entry 

should  be  multiplied  by  T. 

I 
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By  Eq.  (31) 


I 


1 


Var(N)  = 

Aet, 

but  using  the  substitution 
n 

h-  l ' 


(N-tt))2 

the  determinant  of  Eq.  (30)  can  be  expressed  as 
Det^  = nS^  - T2 

7 


or 


Ae^  = n/2  - (<5T)2 


(36) 


(37) 


Hence  the  denominator  of  Eq.  36  can  be  evaluated  using  the  estimates  >JT 
and  N. 


Hence 

Var(N)  = n (38) 

nS2  - (*T)2 

The  standard  deviation  is  the  more  useful  measure  and  is  obtained  by  taking 
the  square  root  of  Var  (N).  This  is  entered  in  column  4 of  the 
sample  table. 


The  variance  of  0T 
as  before,  and  with 

Var(rfT)  = T2 


is  obtained  in  much  the  same  way: 
S9  as  defined, 

£ O 


Detj 


Det-|  is  evaluated 


■ V1’2  (39) 

nS2  - (*T)J 
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D can  be  eliminated  from  both  equations  to  leave  a single  equation. 


1=1 


i k1-1X. 


vT 


Ik 


Xi 


n+1 

2 


(45) 


a.  Estimate  of  MTTF 


For  this  model  the  MTTF  at  the  end  of  the  test,  where  n errors  have  been 
detected,  is  given  by  the  reciprocal  of  the  failure  rate  for  the  n+lst 
error: 

Thus 


MTTF, 


(46) 


b.  Estimate  of  Purification  Percent 

For  comparison  purposes  among  models  the  degree  of  achievement  of  the  "ultimate" 
is  measured,  as  before  by  the  ratio  formed  by  dividing  the  difference  between 
the  initial  and  final  failure  rate  by  the  initial  failure  rate. 

Thus,  in  percent 

P2  = (l-kn)  (100)  (47) 


c.  Variances/Covariances  of  Estimates 

The  variance  and  covariances  for  this  process  are  found  by  the  same 
procedure  used  above.  Distinct  from  the  case  above,  however,  this  process 
has  an  infinite  number  of  errors,  and  so  the  sample  size  can  become  large, 
and  the  asymptotic  formulas  can  be  applied  without  apology. 

Directly  by  differentiation  of  the  likelihood  given  in  Eq.  (42), 

621ogL  = - n (48) 


i 

1 


100 


( 
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i 


62loqL  = 62logL 
SDfik  6k6D 


I (i-l)k1_2X. 
i = l 1 


.iloal  -pi  J (1-1)  -Df  ,2)ki-3x 

6k^  r i=l  i=l  1 


(49) 

(50) 


i: 

f 
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Since  E(X.)  = 1 , the  associated  A-matrix  elements  are 


Dk 


J-T 


'll 


n 

7 


(51) 


fli2  ’ A2i  = d (i-,)  ■ jjL  alnfl 

In  In 

a22  = k2  l 0-U  + ic2  I (i-1 ) ( i -2) 
“ K i=l  K i=l 


(52) 

(53) 


1 n 


1 


= ^ l : (i-l r = ^ n(n-l)(2n-l) 

Using  Det2  to  represent  the  determinant  of  the  A-matrix,  we  obtain  after 
simple  reduction: 


(54) 


^e^2  ~ 22 


n2(n2-l) 

’ T2“ 


(55) 


Thus,  the  variances  and  covariances  are 


var  D » 02 

(56) 

Var  k = k2  — — 

(57) 

n(n2-l) 

Covar  (D,k)  = -Dk 

(58) 
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In  the  limit  these  variances  tend  to  zero.  On  the  other  hand,  it  will  be 
noted  that  the  correlation  coefficient  between  the  estimates  is  quite 
high  (in  absolute  value): 


which  is  in  excess  of  0.85. 


The  estimate  for  the  MTTF  which  has  the  character  of  the  maximum  likelihood 
estimates  is  given  by  Eq.  (27)  as 


where  the  subscript  2 denotes  the  estimate  for  this  process.  The  asymptotic 
approximations  can  be  employed  in  another  reasonable  approximation  in  order 
to  derive  a measure  of  the  variation  in  the  estimate  of  the  MTTF.  By 
differentiation  taking  the  total  differential  and  expectations  it  is 
seen  that 

1 2n 

Var  = D2k2n  Var(D)  + jjljTn+T  Covar  (D.k)  + 


n2 

2",.2n+2 


Var(k) 


D k 


(60) 


where,  again  the  estimates  would  be  used  as  proxies  for  the  (unknown) 
parameters. 


2.  Explanation  of  Appendix  III 

After  elimination  of  one  of  the  parameters  from  the  pair  of  maximum  likelihood 
equations,  there  results  a polynomial  (in  k).  This  polynomial  has  the 
(random)  separation  times  Xj,X2»...,xn  for  coefficients.  Of  course,  it  is 
not  possible  to  formulate  the  equation  until  a realization  of  the  process 
has  occurred;  furthermore,  the  relation  between  0 and  k shown  in  Eq.  45, 
involves  evaluation  of  this  polynomial.  Consequently,  there  Is  no  way 
to  construct  tables  for  this  process. 


I 


i 


! 
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Appendix  III  provides  a convenient  summary  of  the  formulas  which  are 
associated  with  that  process. 

C.  Hybrid  Geometric/Poisson  Process 

Analysis  of  this  model  which  is  described  in  preliminary  form  in  Section  III, 
follows  that  of  the  two  de-eutrophication  models.  Because  some  results  have 
been  produced  which  have  not  previously  published  in  open  literature  a more 
extensive  development  is  made  as  well  as  a description  of  an  application. 


1.  Maximum  Likelihood  Estimates  of  Parameters 

The  likelihood  function  for  the  error  separation  times  = T..-T..  for 
i=l  ,2,. . . ,n,  and  TQ=0,  is: 

L = n Ok1 *]+0  exp  - Dk1_1+g  X. 
i=l  » 1 

The  maximum  likelihood  equations  are  obtained  by  partial  differentiation  of 
the  logarithm  of  the  likelihood  function. These  are 


k1-1 

Dk1_1+0 


n 


r 


(i-l)k1'2  y (i-1 )k1-2X . = 0 

Dk  " +0  1=1 


1 

Dki-1+0 


h - 0 


(61) 


(62) 

(63) 


By  simple  manipulation  on  Eq.  61  it  can  be  converted  to 


n 


.i-1. 


n - e y i = yuk^'x, 

n 


and,  from  Eq.  63,  using  T ■ £ X.,  the  explicit  relation 

9 i-1  ™ 

n - V Dk1  'X, 

0 = 1=1  1 , 


(64) 


(65) 
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can  be  obtained. 


Since  the  second  term  of  the  numerator  represents  the  integral  of  the  failure 
rate  out  to  time  T,  and  so  is  an  estimate  of  the  number  of  non-repeatable 
errors,  the  numerator  represents  the  number  of  "true"  Poisson-like  errors. 
Consequently,  the  quotient  of  this  number  divided  by  time  is  similar  to  the 
corrmonly  employed  estimate. 


The  Eqs.  61,  62  and  63  constitute  a set  of  non-linear  equations  which  can  be 
solved  by  either  the  Newton  method  by  iteration  with  the  Jacobian,  or  by 
the  method, due  to  K.  M.  Brown  [17].  The  latter  method  is  used  in  the 
illustrative  example  following. 


Although  the  Brown  method  is  used,  the  possibility  of  a solution  is  determined 
by  the  evaluation  of  Jacobian  (determinant)  associated  with  the  three  equations. 
If  F](D,k,0),  F2,(D,k,0),  and  FjfD.k,©)  are  used  to  denote  the  left  sides  of 
61,  62  and  63,  respectively,  and  replace  D,  k,  and  0 by  0] , Og,  0-j,  then  the 
Jacobian  entries  are  obtained  by  differentiation.  Thus,  generically  we  have 


J,,  = 


6F,. 


ij  60, 


and  the  particular  entries  are 

J, 


11  i=l  (Dki_1+0)2 


- I 


Jr  = l (i-l)k21"3 

12  <■’  Aw 

i-l 


013  - - S 


k' 

TT 


i=l  (Ok  +0) 
i-l 


5 (Dk1~'+9)(i-l)k1~2-k*"1D(1-1)k 

1=1  (Dk^+O)* 


21 


31 

3 32 

3 33 
1-2 


l 

k1'1 

i=l 

(Dk1_1+0)2 

y 

(i-Dk1"2 

i=l 

(Dk1_1+0)2 

? 

1 

i=l 

(Dk1_1+0)2 

-J  (1-1 )ki_2Xi 
1=1 
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2.  Sample  Application 

The  above  procedure  is  applied  to  the  data  shown  in  Table  XII. 

Table  XII 
Failure  Rate  Data 


Error  No. 

xi 

Error  No. 

Xi 

1 

9 

14 

9 

{ 2 

12 

15 

4 

3 

11 

16 

1 

4 

4 

17 

3 

5 

7 

18 

3 

6 

2 

19 

6 

! 

5 

20 

1 

8 

8 

21 

11 

3 

5 

22 

33 

10 

7 

23 

7 

1 11 

1 

24 

91 

12 

6 

25 

2 

i: 

1 

26 

1 

The  initial  guess  for  the  solution  to  the  three  equations  are  Dq  = .2112, 

kg  = .95125,  and  0Q  = .0576.  The  first  two  correspond  to  the  solution 

obtained  by  solving  the  Eqs.  61  and  62  with  0=0.  The  value  0n  is  obtained 

u 26 

by  evaluating  the  test-end  value  of  the  failure  rate,  that  is  ^“DqIiq  . 

These  three  values  produced  the  starting  point  for  solving  Equations 
61,  62,  and  63,  by  the  Brown  method.  The  resultant  values  are: 
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D = .2211 
k = .9468 
6 = .00106 


The  compare  with  the  values  D=.2112  and  k = .95125  which  were  obtained  with 
the  Geometric  De-Eutrophication  Process. 
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VI.  A PRIORI  RELIABILITY 


One  of  the  possible  areas  of  application  of  random  test  cases  is  in  the 
estimation  of  an  a priori  reliability.  This  can  be  done  in  at  least 
two  ways.  One  of  these  has  been  described  by  Moranda  (18)  in  which 
an  assumed  distribution  of  input  data  is  used  to  estimate  the  average 
(weighted)  number  of  errors  resident  in  a program  before  testing  is  completed. 

In  this  application  the  number  of  instructions  (vis  a vis  segments)  executed  can 
counted  directly.  If  the  sample  cases  are  drawn  randomly  according  to  the 
fitting  operational  probability  law,  then  a simple  calculation  will  give 
what  may  be  called  the  "average  operational  error  content". 

This  is  done  by  applying  the  "Programners  Poisson  Parameter"  which 
is  a universal  constant  of  1 error  per  50  lines  of  code.  If  a run  is  made 
using  the  cases  generated  by  operational-like  data  and  the  result  is  a 
sequence  of  numbers  representing  the  number  of  instructions 

exercised  in  each  run,  then  an  estimate  of  the  average  error  content  is 
the  product  of  1/50  and  the  average  number  of  instructions  exercised. 

Thus,  explicitly 
m 

M * 1/50  J i N. 
is  the  estimated  average  error  content. 

It  might  be  argued  that  the  total  error  content  is  not  so  much  dependent 
onthe  instruction  counts  as  it  is  on  the  number  of  logical  paths  which 
can  be  formed.  Without  arguing  this  point,  one  way  or  another,  it 
is  merely  noted  that  the  method  of  estimating  the  total  number  of  logical 
paths  is  the  only  one  known  which  provides  this  figure,  and  hence  could 
be  used  to  make  this  estimate. 

Once  this  figure  is  arrived  at,  there  is  a new  way  of  providing  an  estimate 
of  reliability.  The  number  of  paths  found  by  test  (and  which  presumably 
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I 

have  furnished  debugging  information  for  their  correction,  and  which  then  f 

can  be  considered  error  free)  subtracted  from  the  estimated  total  number 
produce  a number  which  represents  the  number  proportional  to  the  error  j 

count  (estimate). 

It  should  be  noted  that  the  average  operational  error  content  derived  above 
is  not  related  in  any  simple  way  to  the  total  software  error  content,  since 
the  former  figure  depends  on  the  probability  law  for  the  operational  input 
as  well  as  on  the  structure  of  the  program,  while  the  best  guess  as  to 
the  total  error  content  of  the  package  is  1/50  times  the  total  number  of 
instructions  - some  of  which  may  seldom,  if  ever,  be  exercised. 

Once  threads  through  a program  can  be  established,  a similar  application 
can  be  made  on  them.  The  complications  due  to  loops  and  repeated  instruction 
are  the  major  problems  in  this  respect.  These  can  best  be  resolved  by  forming 
mutually  exclusive  sets,  but  no  clear  cut  best  choice  for  this  process  has 
been  found. 
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Appendix  I 

PROGRAM  TESTING  SYSTEM 


I.  INTRODUCTION 

The  Program  Testing  System  (PTS)  was  designed  as  an  aid  in  software  reli- 
ability studies  of  FORTRAN  programs.  The  PTS  system  uses  the  International 
Mathematical  and  Statistical  Library,  IMSL,  to  generate  the  random  data 
needed  by  the  reliability  study. 

There  are  four  basic  modules  in  the  PTS  system. 

(1)  TEST  CASE  PREPROCESSOR 

The  Test  Case  Preprocessor  generates  a driver  program  for  the 
subroutines  under  study.  It  also  generates  the  data  for  test 
cases  under  user  control . 

(2)  PET  PREPROCESSOR 

The  preprocessor  module  of  the  PET  system  is  used  to  analyze 
the  FORTRAN  source  code  under  study  in  order  to  identify  the 
program  branch  points.  This  information  is  put  on  an  inter- 
mediate file  and  is  used  to  define  program  segments.  It  also 
instruments  the  source  code  in  order  to  gather  execution 
statistics. 

(3)  TEST  CASE  LIBRARY 

The  Test  Case  Library  write  an  intermediate  file  with  execution 
statistics  for  each  test  case.  It  is  transparent  to  the  user. 

(4)  SEGMENT  POSTPROCESSOR 

The  Segment  Postprocessor  using  the  file  generated  by  the  PET 
Preprocessor  defines  the  program  segments  and  prints  the 
reports  needed  in  the  reliability  study. 
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Complete  descriptions  of  modules  (1),  (3)  and  (4)  are  given  in  sections 
II,  III  and  IV.  The  preprocessor  is  described  in  the  PET  Manual  issued 
by  McDonnell  Douglas  Automation  Company. 

Illustration  1-1  shows  the  flow  of  control  through  the  PTS  system. 

i 

The  user  inputs  the  test  case  options  desired  on  cards  to  the  test  case 

preprocessor  which  outputs  a FORTRAN  driver  program.  The  subject 

program  is  input  to  the  preprocessor  which  outputs  instrumented  source 

code  and  a file  with  syntactic  information  to  be  used  by  the  postprocessor.  i 

Then  the  driver  program  and  instrumented  source  are  compiled  and  executed. 

A file  of  execution  statistics  is  generated  at  this  time.  Then  the 
segment  postprocessor  is  executed  using  the  execution  and  syntactic 
statistic  files  and  generating  the  reports  needed  for  the  reliability 
study. 

1 1 . TEST  CASE  PREPROCESSOR 

The  Test  Case  Preprocessor  constructs,  under  user  control,  the  random 
data  for  test  cases  needed  to  drive  the  subroutines  being  studied.  In 
addition,  it  automatically  generates  a FORTRAN  program  to  execute  the 
subroutines.  A restriction  of  the  study  is  that  all  input  must  be 
through  the  calling  sequence  of  the  subroutine. 

Four  types  of  random  distributions  may  be  specified:  Uniform,  Triangular, 

Beta  and  Truncated  Normal.  The  user  must  supply  the  range  of  values  that 
the  input  parameter  may  assume.  The  range  must  be  on  the  field  of  real 
numbers.  A most  likely  value  (mode)  may  be  input;  otherwise,  it  is 
assumed  to  be  at  the  center  of  the  range.  The  random  numbers  are  then 
mapped  into  the  range  or  into  the  log  of  the  range  according  to  a linear 
interpolation. 

One  of  the  above  distribution  options  is  specified  for  each  individual 
variable  or  array.  The  same  options  are  in  effect  for  all  the  test 
cases. 
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II.l  Random  Methods  Used 


The  initial  seed  for  generating  the  random  numbers  is  obtained  from  the 
system  clock  accurate  to  1/1000  second.  The  fractional  part  of  the 
time  divided  by  1000,  TIME/1000,  is  used,  which  gives  a number  between 
0 and  1 with  6 significant  digits.  Since  the  TIME  parameter  is  given 
in  seconds,  this  number  repeats  approximately  every  15  minutes.  Subsequent 
seeds  are  obtained  fromthe  IMSL  uniform  random  number  generator,  GGU1. 

11. 1.1  Uniform  Distribution 

The  IMSL  subroutine  GGU1  is  entered  once  to  obtain  uniformly  distributed 
random  numbers  for  all  cases  for  the  given  variable/array.  The  equations 
for  mapping  the  random  numbers  into  the  range  are  given  below. 

Given  a range  of  (a,c)  and  random  numbers  r^ , i=l,  n,  these  are  mapped 
into  the  range  by 

si  = a + Ti  (c-a)  (1-1) 

If  the  range  represents  the  log^Q  of  the  actual  range, 
r. 

t^  = k (10  1 ) where  (1-2) 

k = +1  if  r ...  > .5  and 
n-i  + 1 

k 5 1f  Wi  i -5- 

11. 1.2  Triangular  Distribution 

The  IMSL  subroutine  GGU1  is  entered  once  to  obtain  uniformly  distributed 
random  numbers  for  all  cases  for  the  given  variable/array.  Then  the 
random  numbers  are  mapped  into  the  range  using  a triangular  distribution. 


I 

I 

1 


116 


Given  a range  (a,c),  a mode  b,  and  an  array  of  random  numbers  r-j , 1=1, 
n,  where  0 < r^  <1,  the  following  equations  are  used. 

If  o < !-.<  b^a  , then 
1 c-a 

s.  = a + [ri  (c-a)  (b-a)]1/2  (1-3) 

If  kli  < r.  < 1 , then 
c-a  - 1 - 

Si  = c - [(c-b)  (c-a)  (l-r.)]1/2  (1-4) 

If  the  range  represents  the  log^  of  the  number,  then  equation  1-2  is 
used  to  obtain  the  actual  numbers. 

II. 1.3  Beta  Distribution 

In  order  to  obtain  n B-distributed  random  numbers,  the  IMSL  subroutine 
GGBET  is  entered  n times.  The  GGBET  routine  requires  a p and  q which 
are  multiples  of  1/2.  These  are  obtained  using  the  following  equations. 


L MU 


Let  (L,U)  be  the  range  and  M the  mode. 
Then  E (u)  = 1 (L  + 4M  +U) 

m = (E  (u)  - L)/R  where  R = U - L 

Ps*  m (36m  (1-m)  - 1) 
and 

qs“  (l-m)(36m  (1-m)  - 1) 


(1-5) 

(1-6) 

(1-7) 

d-8) 
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(1-9) 


Since  p and  q must  be  multiples  of  1/2,  the  following  approximation  must 
be  used: 

p = int  (2p$  + . 5 )/2 
q = int  (2q$  + .5)/2 
where  int  = integer  part. 

If  the  range  represents  the  log^g  of  the  number,  then 

t = k (10  ) where  r is  the  B-distributed  random  number, 
k = + 1 depending  on  the  value  of  s(n). 

where  s(n)  is  a uniformly  distributed  random  number  obtained  during 
the  computation  of  4. 

II. 1.4  Truncated  Normal  Distribution 

The  IMSL  routine  G6N0R  is  entered  once  to  obtain  normally 
random  numbers.  Since  a truncated  normal  is  desired,  the 
specify  a range  and  the  amount  of  truncation  indicated  by 
mean  will  be  assumed  to  be  at  the  midpoint  of  the  range, 
range  be  given  by  (a,b).  Then 

m = (a  + b)/2 
a = (b  - a)/2k 

The  normal  variable  r^  is  mapped  into  the  range  using 
s 3 a.  r^  + m 

For  k = 1.96  about  1 in  20  numbers  are  not  in  the  range  and  for  k = 2.58, 

1 in  100  are  not  in  the  range.  To  account  for  this,  for  1.96  < k < 2.58, 

5%  over  the  nominal  amount  of  normal  numbers  are  produced.  And  for 
k >2.58,  1%  additional  are  produced. 

If  the  s produced  by  1-12  is  not  In  the  range  specified,  it  will  be  discarded 
and  r1+1  will  be  tried. 


distributed 
user  must 
k.  The 
Let  the 


(1-10) 

(1-11) 


/ * 4 n \ 
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III.  TEST  CASE  LIBRARY 

The  Test  Case  Library  writes  a tape  with  execution  statistics  for  each 
test  case.  It  is  loaded  with  the  PET  instrumented  code  and  is  transparent 
to  the  user  in  the  PTS  system.  The  library  consists  of  three  subroutines 
QERRQ,  QPOST  and  QPCASE.  Subroutine  QPCASE  writes  case  information  on 
the  tape  every  time  it  is  called.  Subroutine  QPOST  "wraps  up"  the  run. 

There  are  two  records  written  on  the  tape  for  each  case.  The  first 
record  contains  the  branch  and  statement  execution  counts  and  the  second 
record  contains  the  variable  assignment  information. 

IV.  SEGMENT  POSTPROCESSOR 

The  segment  postprocessor  defines  the  program  segments  and  prints  the 
reports  necessary  for  the  reliability  study.  The  annotated  source  file 
fromthe  PET  preprocessor  is  used  to  define  the  FORTRAN  program  segments. 

There  is  a limit  of  1000  segments  which  for  a "typical"  program  would 
represent  about  500  source  statements.  A complete  description  of  a 
FORTRAN  segment  as  defined  in  the  PTS  system  is  given  in  Section  IV. 2. 

There  is  no  user  input  to  the  segment  postprocessor.  The  reports  generated 
by  the  segment  postprocessor  are  described  in  detail  in  the  following 
section. 

IV. 1 Postprocessor  Reports 

The  first  report  contains  the  FORTRAN  source  listing  followed  by  the  statement 
numbers  assigned  by  the  PTS  system.  Each  executable  FORTRAN  statement  is 
assigned  a number.  A logical  IF  statement  is  assigned  two  numbers,  one  for 
the  IF  portion,  and  one  for  the  true  branch  of  the  IF.  This  report 
allows  the  PTS  user  to  correlate  the  program  segments  with  the  actual  source 
statements. 

The  second  report  describes  the  FORTRAN  segments  as  defined  by  the  PTS  system. 
Each  segment  consists  of  a set  of  statements  that  are  executed  sequentially. 
Two  symbols  are  used  In  defining  segments  and  A indicates 

a branch  and  indicates  inclusive  execution  of  the  statements  indicated. 

A "-1"  Is  used  to  indicate  an  unresolved  branch  to  a FORTRAN  label.  At 
the  present  time,  it  is  left  ot  the  PTS  user  to  resolve  such  branches. 
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As  an  example,  a segment  described  as  (1-3,5)  would  Include  statements 
(1,2, 3, 5).  The  first  statement  of  a segment  is  the  last  statement  of  its 
predecessor  segment(s).  Using  the  segment  report,  program  paths  may 
be  constructed  by  the  PTS  user.  The  execution  statistics  for  the 
segment  are  printed  beside  the  segment  description.  At  the  end  of  the 
report,  the  percentage  of  the  segments  that  were  executed  for  each  case 
are  printed. 

The  third  report  shows  the  percentage  of  the  cases  that  executed  each 
segment.  For  instance,  if  segment  3 shows  non-zero  execution  counts 
for  4 of  10  test  cases,  40%  would  be  printed. 

The  final  report  is  a summary  of  the  segments  that  were  not  executed. 

The  percentage  of  the  segments  that  were  not  executed  for  any  test 
case  is  printed. 

IV. 2 Algorithm  for  Defining  FORTRAN  Program  Segments 

A program  segment  consists  of  a set  of  statements  that  are  always  executed 
sequentially  and  has  one  entrance  and  one  exit.  All  segments  have  at 
least  one  predecessor  segment  except  those  starting  with  a subroutine 
entry.  All  segments  have  at  least  one  successor  segment  except  those  ending 
on  a return  or  halt. 

There  are  four  criteria  for  beginning  a new  segment. 

(1)  a subroutine  or  entry  statement 

(2)  a statement  label 

(3)  a 00  statement 

(4)  termination  of  a previous  segment 

A segment  will  terminate  if  one  or  more  of  the  following  conditions  are 
encountered: 

(1)  a RETURN  or  STOP  statement 

(2)  a branching  statement 

(3)  a CALL  statement 

(4)  the  end  of  a DO  loop 

(5)  the  beginning  of  a new  segment 
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A FORTRAN  multiple  branch  statement  will  cause  several  segments  to  be 
generated.  For  this  reason,  a given  statement  may  be  contained  in 
more  than  one  segment. 

Illustration  1-2  shows  a sample  of  a FORTRAN  proqram  and  the  seqments 
that  were  defined  by  the  PTS  system. 

Segment  1 was  terminated  because  a FORTRAN  program  need  not  return 
after  a CALL  statement.  -Segment  2 was  terminated  because  of  the  statement 
label.  Segments  3 and  4 represent  the  path  taken  by  the  FALSE  and  TRUE 
branch  of  the  logical  IF,  respectively.  Segment  9 terminated  upon  entry 
into  the  DO-loop,  since  the  segment  model  being  used  differentiates 
between  loops  which  "fall  through"  immediately  and  those  which  are 
iterated  cn.  Segment  11  represents  the  path  out  of  the  00-loop. 
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SAMPLE  PROGRAM  SEGMENTS 


STATEMENT 

NO. 

NO. 

DESCRIPTION 

CALL  OVERFL 

1 

1 

1 -2 

N-J 

2 

2 

2-3 

900 

TAU  • .ID-29 

3 

3 

4 

3-24.26 
3 - 25.  -1 

NN-N 

23 

IF  ( ) GO  TO  6601 

24-25 

9 

30-31 

26 

10 

31  -32 

11 

32-33 

6560 

DO  4000  1-1,  M 

30 

DRII)  - ARIJ) 

31 

4000 

OKI)  -QU) 

32 

RETURN 

33 

Figure  1-2.  Sample  FORTRAN  Program  and  Segments 
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Appendix  II 

TABLES  FOR  THE  DE-EUTROPHICATION  PROCESS 

Presented  in  the  following  set  of  tables  are  the  estimates  of  model 
parameters  and  of  their  variances/covariances  as  well  as  estimates  of 
the  MTTF  (at  the  end  of  the  test)  and  the  purification  percentage. 

These  tables  are  derived  from  the  data-derived  ratio 

I (i-l)X. 

R = 1*1  1 


in  the  manner  described  in  Section  5.  Once  R is  calculated,  values  for 
all  other  parameters  can  be  obtained  by  table  lookup. 

The  technique  as  well  as  the  use  of  the  tables  is  described  in  Section  5, 
where  sample  table  (Table  XI  on  page  97)  is  explained.  Footnotes  on  that 
table  apply  here. 
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N s 15 


HAT  10 

TOTAL 

STfcH 

VAR 

FUROR 

vaR 

iiTfcP 

C0VAH 

MT  1 F 

7.2 

1U0.50 

.1608 

519,99 

,8971 

• 465 

,9663 

, 0727 

7.4 

03.98 

,3??0 

129,48 

,0939 

•115 

,0673 

, 0 797 

7 .6 

.18,59 

. 4841 

57,19 

,9820 

•5l 

.0875 

,go76 

7 . 8 

30.96 

,0475 

31,87 

,9063 

• 28 

,3073 

, 0967 

8.0 

26,45 

,ai?9 

?C,15 

,9120 

-17 

,66o3 

,1074 

5.2 

23, 50 

,93o5 

1 i 1 7 8 

,9190 

-12 

,1778 

,1200 

8.4 

21. 4 J 

1 .1510 

9,95 

,9277 

• fl 

, 7458 

,1351 

8.6 

19,92 

1.3251 

7,46 

,9300 

• 6 

,5158 

,1534 

8 , 8 

16,78 

1.5034 

5,79 

,9500 

• 4 

,9098 

,1761 

9.0 

17.90 

1 ,68b2 

4,54 

,9644 

• 3 

,9060 

, 2u  4 8 

0 . ?. 

17.20 

1,5754 

3,64 

,9807 

• 3 

,1019 

,2426 

9.4 

16.64 

?.C7l4 

2,95 

,9998 

l,0?l8 

• 2 

,4946 

,2941 

9.6 

16.19 

2.2758 

2,42 

-2 

,0237 

,3689 

9.8 

15,62 

2.4897 

2, on 

1.U474 

•1 

,6550 

,4*69 

10.0 

15,52 

2.7151 

1,88 

1,0773 

•1 

,3614 

,7o2l 

10.? 

15.23 

2,9545 

1,39 

1,1121 

• 1 

,1251 

1,2221 

10.4 

15.07 

3 , 211)7 

1,17 

1.1528 

* 

,9337 

4,333; 

Column  1 is  th«  ratio  I(l-l)Xi  / £Xj 

Column  2 Is  tbs  estimate  for  the  total  error  content 

Column  3 Is  the  nomed*  estimate  for  step  size:  In  order  to  determine  the 

actual  estimate  of  the  step  size,  the  entry  In  this  column  should  be  divided 
by  the  total  observation  time  T. 

Column  It  Is  the  approximate  standard  deviation  of  the  estimate  of  the  total 
error  content. 

Column  5 Is  the  normed  standard  deviation  of  the  estimate  of  the  step  size: 
In  order  to  obtain  the  actual  standard  deviation  the  entry  in  this  column 
should  be  divided  by  the  total  time  T. 

Column  6 Is  the  normed  covarisnce  between  H and  i:  In  order  to  obtain  the 

actual  estimated  covariance  the  entry  should  be  divided  by  T. 

Column  7 Is  the  normed  MTTF  and  In  order  to  obtain  the  actual  va'ue  the 
entry  should  be  multiplied  by  T. 
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N * 16 


I 


I 


HAT  JO 

TUTAL 

FRHOR 

ST^P 

S1ZF 

VAR 

FRRUR 

w*R 

STEP 

CQV  AH 

hTU 

0.0 

*0.39 

. 3774 

97,26 

,«70V 

*84,2061 

, 0770 

8.2 

36,41 

.5297 

49,27 

,6740 

•42,5688 

,0643 

6.4 

31,62 

,6131 

29,54 

,6763 

•25,4517 

,0V25 

0.6 

27.69 

,6383 

19,54 

, 6 fl  3 7 

-16,7772 

,1021 

0.0 

24,07 

,9957 

13,79 

,6902 

•11,7865 

,1132 

9.0 

?2.65 

1.1556 

10,1.9 

,6960 

•8,6624 

,1264 

9.2 

21.33 

1.3166 

7,7e 

, y072 

•6,5738 

,1422 

9,4 

20.17 

1.4951 

6,09 

. V 18 1 

-5,1144 

,1613 

9.6 

19,26 

1,6559 

4,66 

,V3Q5 

•4,0527 

, 1651 

9.0 

16. 54 

1.6315 

3,94 

,9449 

*3,2569 

,2153 

10.0 

17. 9S 

2.0130 

3,23 

,9613 

*2,6468 

,2550 

10.2 

17.47 

2.2015 

2,68 

, Vflol 

-2.17Q9 

,3095 

10.4 

17.07 

2.397b 

2,23 

1 , 0 0 1 7 

*1.7926 

,3066 

10.6 

16. 7S 

2,6037 

1,67 

1,0263 

*1,4857 

,5154 

10.0 

16.47 

2.32C1 

1,58 

1,0549 

*1,2389 

, 7467 

11.3 

16.25 

3.0493 

1.34 

1,0880 

-1,0370 

1,3273 

11.2 

16,06 

3.2941 

1,13 

1,1264 

",  8 7 0 7 

5 ,3138 

Column  1 is  the  ratio  l(l-l)Xi  / 

Column  2 Is  the  estimate  for  the  total  error  content 

Column  3 Is  the  normed- estimate  for  step  site:  in  order  to  determine  the 

actual  estimate  of  the  step  size,  the  entry  In  this  column  should  be  divided 
by  the  total  observation  time  T. 

Column  U is  the  approximate  standard  deviation  of  the  estimate  of  the  total 
error  content. 

Column  5 is  the  normed  standard  deviation  of  the  estimate  of  the  step  size: 
la  order  to  obtain  the  actual  standard  deviation  the  entry  in  this  column 
should  be  divided  by  the  total  time  T. 

Column  6 Is  the  normed  covariance  between  N and  in  order  to  obtain  the 
actual  estimated  covariance  the  entry  should  be  divided  by  T. 


->  Column  7 Is  the  normed  KTTF  and  in  order  to  obtain  the  actual  va'ue  the 

entry  should  be  multiplied  by  T. 
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RAT  JO 

total 

STL;R 

VAR 

VAR 

cqvah 

MTTF 

ERROR 

sizr 

FRHOR 

isTEP 

8.? 

128,16 

, 1 4 1 7 

712,14 

,0420 

•599,1572 

,0635 

8 .4 

68,32 

.2837 

177,54 

,0434 

-149,2391 

, U687 

8.6 

48,47 

,4?64 

79,48 

,0455 

•65,8611 

, 0745 

8.8 

38,63 

.5698 

43,85 

,0488 

•36,7176 

,0*111 

9.0 

32.79 

.7146 

27,80 

,0528 

•23,2121 

, 0066 

9.2 

28,95 

,o6q9 

19,08 

,0578 

•15,8789 

,0*72 

9.4 

26.25 

1 , C09u 

13,04 

,0640 

•11,4674 

,1072 

9.6 

24.26 

1.1595 

10,43 

,0712 

•6,5956 

,1180 

9.8 

22.75 

1.3127 

a . o9 

,0795 

• 6 | 6 3 1 8 

,1325 

10 . 0 

21.57 

1.4691 

6,42 

,0892 

-5,2273 

,146V 

10  .? 

2C.63 

1,6792 

5,18 

,9002 

•4,1901 

,1689 

10.  A 

19,88 

1.7934 

4,24 

,9128 

•3,4044 

,1*37 

10.6 

19,26 

1,9623 

3,51 

,9270 

•2,79ie 

,2253 

— - 

10.8 

18.75 

2.1377 

2,93 

,9433 

•2,3101 

,266V 

11.0 

18,33 

2,3168 

2,47 

,9619 

•1,9252 

,3239 

11.  ? 

17.93 

2,5079 

2,09 

,98  29 

•1.6110 

, 4 U 7 5 

11  .4 

17,68 

2,7056 

1,77 

1,0069 

•1,3546 

,54  09 

11.6 

17,43 

2,9138 

1,51 

1,0343 

•1,1420 

, /*03 

11.8 

17,22 

3.1144 

1,29 

1 , 0656 

•,9648 

1,4260 

12.0 

17,05 

3.3689 

1,11 

1,1010 

• ,8 183 

6,428/ 

Column  1 Is  the  ratio  l(l-l)X^  / txA 

, Column  2 is  the  estimate  for  the  total  error  content 

Column  3 Is  the  normed* estimate  for  step  site:  in  order  to  determine  the 

actual  estimate  of  the  step  site,  the  entry  in  this  column  should  be  divided 
by  the  total  observation  time  T. 

Column  U is  the  approximate  standard  deviation  of  the  estimate  of  the  total 
— / error  content. 


Column  5 is  the  normed  standard  deviation  of  the  estimate  of  the  step  site: 
in  order  to  obtain  the  actual  standard  deviation  the  entry  in  this  column 
should  be  divided  by  the  total  time  T. 


Column  6 Is  the  normed  covariance  between  N and  4:  in  order  to  obtain 

actual  estimated  covariance  the  entry  should  be  divided  by  T. 


Column  7 is  the  normed  MTTF  and  in  order  to  obtain 
entry  should  be  multiplied  by  T. 


the  actual  va'.ue  the 
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N a 1 fl 


patio 

TUTAL 

S 7 b P 

VAR 

VAR 

CQVAR 

"TIP 

ERROR 

SIZE 

FRI<0« 

STEP 

9.0 

62.73 

.3350 

130.94 

,«202 

-106,0940 

, 0667 

9 . ? 

47.51 

. A 69 9 

66,45 

,6?25 

-54,1557 

,07*1 

9 .4 

39.12 

,6057 

39,69 

,8255 

1-32,43*1 

,0782 

9.* 

33.64 

. 7 426 

26,47 

,82  94 

-21,4577 

, 0850 

9. « 

30.23 

. 6 '1 1 C 

18,74 

,8342 

-15,1307 

, 0928 

10 . U 

27.03 

1 , C ? 1 0 

13,90 

,8399 

-11,1830 

, 1 V 1 7 

10-? 

25.60 

1.1632 

10,66 

, 8405 

*8,5:333 

,1120 

10  . A 

24.16 

1 ,3076 

8,35 

,6541 

- 6 , 6 7 6 3 

,124] 

10.6 

22.97 

l,4r»54 

6,73 

,0627 

-5,324* 

,1303 

10  • h 

22.01 

1 • 6 0 5 7 

5,49 

,0727 

r 4 , 3 1 71 

, 1553 

11.0 

21.23 

1.7601 

4,53 

,a0j8 

-3,5307 

,1761 

11.2 

2 0.56 

1.9104 

3,79 

.0966 

-2 , 9 3 15 

,2010 

11.4 

20.0? 

2 , G 4 1 7 

3.19 

,*108 

- 2 , 4 A 55 

, 2347 

11.6 

19.00 

2.2504 

2,7  0 

,9260 

-2,0533 

, 270  U 

11.8 

19.22 

2.4257 

2,30 

,9449 

-1,7312 

,3378 

12.0 

16.90 

2,6079 

1,97 

,9654 

-1,4664 

,4*51 

12.2 

1.6.63 

2.7906 

1,69 

,9865 

-1,2458 

,5656 

12.4 

18.40 

2,9995 

1,46 

1,0147 

-1,0598 

,8314 

12.6 

18,21 

3,211? 

1.26 

1,0446 

-,9049 

1,5150 

12. « 

16.04 

3,4365 

1,09 

1,0787 

-,7735 

7,6774 

Column  1 is  the  ratio  l(l-l)X^  / 

Column  2 is  the  estimate  for  the  total  error  content 

Column  3 Is  the  normed- estimate  for  step  size:  In  order  to  determine  the 

actual  estimate  of  the  step  size,  the  entry  in  this  column  should  be  divided 
by  the  total  observation  time  T. 

Column  4 Is  the  approximate  standard  deviation  of  the  estimate  of  the  total 
error  content. 

Column  5 Is  the  normed  standard  deviation  of  the  estimate  of  the  step  size: 
In  order  to  obtain  the  actual  standard  deviation  the  entry  in  this  column 
should  be  divided  by  the  total  time  T. 

Column  6 is  the  normed  covariance  betveen  N and  4:  In  order  to  obtain  the 

actual  estimated  covariance  the  entry  should  be  divided  by  T. 

Column  7 Is  the  normed  KTTF  and  in  order  to  obtain  the  actual  value  the 
•nti-v  should  be  multiplied  by  T. 
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N 


19 


RATIO 

total 

Ff  Rqo'R 

step 

srzr 

WAR 

FRROR 

VAH 

STEP 

CQVAH 

MTTP 

9.2 

159.15 

.1267 

941,55 

, 7961 

•749,0902 

, 0563 

9,4 

84.3? 

.2536 

234,85 

.'971 

•186,7059 

, 0 6 Q 4 

9.6 

59.47 

, 3 8 1 0 

103,93 

, 7987 

-02,5185 

, 0649 

9.8 

47.13 

, 5 u 8 9 

56,14 

.“nil 

■46,0007 

,0f9tt 

10 .0 

39.79 

,o377 

36,94 

.8042 

•29,2121 

, 0754 

10.2 

3 4 .95 

, 7677 

25,42 

,6079 

•20,0442 

,0017 

10.4 

31.54 

, H q 8 9 

18,40 

,8124 

•14,5182 

, 0«67 

10,6 

29.0? 

1 ,C3l6 

13,97 

, 83  78 

•10,9398 

,0*68 

10.8 

2 V . q9 

1 . 3.665 

1 0 » 

,6230 

■8,4747 

,1060 

11,0 

25.58 

1,3032 

8,67 

, 8309 

■6,7246 

,116ft 

11,2 

24,37 

1 , 44?6 

7,03 

,8387 

• 5,42(j4 

,1293 

11,4 

23,39 

1,5546 

5,60 

,8478 

■4,4391 

,143' 

11.6 

22,58 

1,7301 

4,83 

,8570 

*3 , 6 7 o9 

,1814 

11.8 

21.VJ 

1,6794 

4,06 

,8689 

• 3 , 0 6 1 3 

,1029 

12,0 

21.35 

2,0324 

3,44 

.8*16 

•2,5746 

,2095 

12.2 

20,68 

2 , 1 9 0 2 

2,94 

2,52 

,8957 

■2,1782 

,2435 

12.4 

20.47 

2,3533 

,9116 

•1,8510 

,2883 

12,6 

20,13 

2,5230 

?,17 

,9291 

-1,5763 

,3505 

12,8 

19,84 

2,6995 

1,87 

, 9488 

•1,3473 

,4418 

13.0 

19,59 

2 , 6833 

1,63 

,9713 

•1,1562 

,5881 

13.2 

19,37 

3,0771 

i,n 

,9963 

-,9919 

, 6676 

13,4 

19.19 

3,2831 

1,23 

1,0240 

•,8536 

1,S>977 

13.6 

19.03 

3 , 4079 

1,07 

1,0570 

-.7348 

8,9646 

Column  1 Is  the  ratio  £(l-l)X^  / £X^ 

Column  2 Is  the  estimate  for  the  total  error  content 

Column  3 Is  the  normed- estimate  for  step  sizes  In  order  to  determine  the 
actual  estimate  of  the  step  size,  the  entry  in  this  column  should  be  divided 
by  the  total  observation  time  T. 

Column  It  is  the  approximate  standard  deviation  of  the  estimate  of  the  total 
error  content. 

Column  5 is  the  normed  standard  deviation  of  the  estimate  of  the  step  size: 
in  order  to  obtain  the  actual  standard  deviation  the  entry  in  this  column 
should  be  divided  by  the  total  time  T. 

Column  6 Is  the  normed  covariance  between  K and  tf:  in  order  to  obtain  the 

actual  estimated  covariance  the  entry  should  be  divided  by  T. 


Column  7 is  the  normed  MTTF  and  in 
entry  should  be  multiplied  by  T. 


order  to  obtain  the  actual  va\ue  the 
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I 

RATJfi 

Total 

LHRCJR 

SUP 
s i zr 

VAR 

HRROf* 

VA« 

STfcP 

HTTP 

I 

10.0 

76.40 

.3012 

170,75 

,7774 

•132,2428 

,0569 

J 

10.2 

57.5*; 

. 4224 

86,71 

,7751 

•67,0543 

, U63Q 

j 

L 

10 . 4 

47.16 

.5441 

52.,  16 

,7315 

•40,2679 

, 067  / 

10.6 

40.60 

, 6 6 6 7 

34,65 

, 7844 

-26,6639 

, 0728 

10.0 

36.11 

. 1 9 0 3 

24,59 

, 7860 

•18 , 68 l6 

, u /e  6 

11.0 

32.65 

.9152 

10.28 

,7923 

•I3,9e68 

, 0850 

11.? 

30.4  0 

1 • 04  J 5 

14 , 06 

, 7972 

•10,7167 

, 0923 

w 

11.4 

26.60 

1 .1694 

11,10 

,8030 

•8,4301 

,1006 

11.6 

26.99 

1.2996 

6,94 

,8092 

•6,7545 

.1101 

li.O 

26.77 

1 . 4 3 1 7 

7,33 

,0165 

• 5 , 5 0J9 

,1211 

12.0 

24,77 

1 ,5664 

6,08 

,6246 

•4,5429 

,1339 

12.? 

23.94 

1,7037 

5,11 

,8336 

• 3 | 79  j4 

,1490 

12.4 

23.24 

1,8444 

4,33 

,8439 

-3,1867 

,1672 

12.6 

22.66 

1,9»>86 

3,69 

,0552 

•2,6992 

,1892 

12,6 

22.16 

2,1369 

3 ,17 

,8677 

,8817 

•2,2960 

,2167 

13.0 

21.73 

2.2897 

2,74 

•1,9654 

,2518 

w 

13.2 

21.37 

?,4  4fa6 

2,37 

,8969 

•1,6636 

,2965 

13.4 

21. 

2,6124 

2,06 

, 9 J,  4 1 

•1,4490 

,3625 

% 

13.6 

20.79 

2,7827 

1,80 

,9335 

•l,25g8 

,4564 

13. a 

20.55 

2.9609 

1,57 

,9550 

• 1 , Of  07 

,6088 

14.0 

20,35 

3,1482 

1,37 

,9790 

-,9339 

, 9004 

14.2 

?0.1* 

3.3448 

1,20 

1 , U062 

•,8098 

1,6661 

14.4 

20.03 

3,5536 

1,05 

1,0366 

-,7017 

10,0229 

! 


j* 


i 


I 


11 


1 


1 


Column  1 Is  the  ratio  C(l-l)X^  / £X^ 

Column  2 Is  the  estimate  for  the  total  error  content 

Column  3 is  the  normed* estimate  for  step  size:  In  order  to  determine  the 

actual  estimate  of  the  step  size,  the  entry  In  this  column  should  be  divided 
by  the  total  observation  time  T. 

Column  U Is  the  approximate  standard  deviation  of  the  estimate  of  the  total 
error  content. 

Column  5 is  the  normed  standard  deviation  of  the  estimate  of  the  step  size: 
In  order  to  obtain  the  actual  standard  deviation  the  entry  in  this  column 
should  be  divided  by  the  total  time  T. 

Column  6 Is  the  normed  covariance  between  N and  tf:  In  order  to  obtain  the 

actual  estimated  covariance  the  entry  should  be  divided  by  T. 

Column  7 is  the  normed  HTTP  and  in  order  to  obtain  the  actual  va’ue  the 
entry  should  be  multiplied  by  T. 
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N s 21 


HAT  IP 

total 

STFP 

VAR 

VAR 

covar 

m r T f 

ERROR 

SIZL- 

ERROR 

STEP 

10-2 

1*3.50 

,1146 

1210.63 

, 7371 

•V16,096« 

, 0506 

10 . 4 

1 u 1 . 9 p 

.2293 

301,90 

,7378 

•228,3303 

,0539 

10 .4 

71.59 

,3443 

133,79 

, 7591 

•101,0581 

, 0574 

10. A 

56.47 

,4598 

74,93 

,7610 

•56,5231 

,0613 

11 .0 

47.46 

,5759 

47,66 

, 7633 

•35,8842 

,0656 

11.2 

41.51 

,6929 

32,84 

, 7660 

•24,6640 

, 0704 

11.4 

37.30 

,8108 

23,93 

, 7696 

•17,9193 

, 0757 

11.6 

34,1*5 

,9?99 

18,13 

, 7736 

-13,5333 

, 0B16 

11.3 

31,79 

1,0503 

14,16 

, 7782 

•10,5285 

,0582 

12.0 

29.91 

1.1723 

11.31 

,7031 

•8,3771 

,0957 

12.2 

23,41 

1.2958 

9,22 

, 7393 

•6,7944 

,1042 

12.4 

27.18 

1.4213 

7,62 

, 7963 

•5,59i3 

,1139 

12.6 

26,16 

1,5492 

6,30 

,6037 

•4 , 65 13 

,1252 

12. a 

25.30 

1 ,680C 

5,39 

,«11« 

•3,9033 

,1384 

13.0 

24,59 

1,8131 

4,60 

,"210 

•3 , 3060 

,1540 

13.2 

23,97 

1,9194 

3,95 

,"312 

•2,8175 

,1726 

13,4 

23.45 

2.0497 

3,41 

,84  22 

•2,4113 

,1954 

13.6 

23,00 

2,2332 

2,96 

,8548 

•2,0763 

,2235 

13.8 

22,62 

2,3320 

2,57 

,8683 

•1,7905 

,255  7 

14.0 

22,23 

2,5353 

2,25 

,3034 

•1,5498 

, 3074 

14.2 

21,99 

2,6946 

1,97 

,9001 

•1,3431  ... 

,3735 

14.4 

21.74 

2 , d 6 0 0 

1,73 

,9187 

•1,1670 

, 4707 

14.6 

21,52 

3,0325 

1,52 

,9394 

•1,0154 

,6283 

14,8 

21.34 

3,2134 

1,34 

,9626 

-,8043 

,9265 

15.0 

21,17 

3,4033 

1,18 

,9085 

• i 7716 

1,7236 

15.2 

21,03 

3,6044 

1,04 

1,0174 

-.6733 

10,5569 

Column 

1 is  the  ratio 

tli-DXi 

/ 

Column  2 is  the  estimate  for  the  * 

total  error  content 

Column  3 is  the  not  ' 

’'-estimate  for  step  size: 

In  order  to 

determine  the 

actual 

estimate  of  t». 

'ep  size. 

the  entry  in 

this  column 

should  be  divided 

by  the  total  observatii—  time  T. 

Colunn  It  It  tbt  approximate  standard  deviation  of  tbe  estimate  of  the  total 
error  content. 

Column  5 it  the  noraed  standard  deviation  of  the  estimate  of  the  ttep  size: 
in  order  to  obtain  the  actual  standard  deviation  the  eotry  in  this  column 
should  be  divided  by  the  total  time  T. 

Column  6 1s  the  noraed  covariance  betveen  N and  i\  in  order  to  obtain  the 
actual  estimated  covariance  the  entry  should  be  divided  by  T. 

Column  7 is  the  noraed  HTTP  and  in  order  to  obtain  the  actual  va'.ue  the 
entry  should  be  multiplied  by  T. 


Is  = 22 


RATIO 

TOTAL 

STfcP 

VAR 

VAR 

cqvar.. 

MJ  IF 

ERROR 

SIZE 

FRROU 

STEP 

11.0 

’1.40 

.2736 

216,98 

, 7 4 0 8 • 

160,2254 

,0927 

11.2 

6b, 55 

.3636 

1 1 0 i 26 

, 7420 

*-»l . 32  01 

, 0960 

11.4 

55,94 

,4939 

66,41 

, 7440 

v46,9jq3 

,0557 

11.6 

47,97 

,6050 

44, 19 

, 7463 

*32,4756 

,0637 

11 .8 

42.49 

,7168 

31,40 

, 7490 

*23,0251 

,0061 

12.  t, 

38,52 

.6294 

23,39 

, 7524 

"17,1010 

, 0730 

12.2 

35,52 

,9433 

18,02 

, 7561 

"13,1322 

, 0704 

12.4 

33.19 

1,0^82 

14,27 

, 7605 

*10,3650 

,0844 

12.6 

31,33 

1.1748 

11.53 

, 7653 

•0,3372 

,0913 

12.  S 

29, 62 

1.2926 

9,48 

, 7709 

*6,8227 

, 0969 

13.0 

26,5  8 

1,4123 

7,90 

, 7772 

*5,6620 

,1077 

13.2 

27,54 

1,5341 

6,66 

, 7841 

-4,7462 

,1177 

13,4 

26,67 

1,6584 

5,67 

,7915 

•4,0120 

,1292 

13.6 

25.92 

1,7850 

4,86 

,79y9 

•3,4174 

,1427 

13,8 

25 , 2‘* 

1,9145 

4,19 

,6090 

•2,9280 

,1967 

14.  C 

24,75 

2,0468 

3,64 

,6192 

•2,5241 

,1773 

14.2 

24.23 

2.1828 

3,17 

,6302 

*2,1626 

,2010 

14.4 

23,87 

2,3730 

2,76 

,6423 

•1,8923 

, 2301 

14.6 

23,52 

2.4667 

2,44 

,6559 

•1,6465 

, 2669 

14,0 

23,21 

2,6160 

2,15 

,6706 

•1,4364 

,3160 

15.0 

22,94 

2,7703 

1,90 

,6869 

"1,2547 

,3839 

15.2 

22.71 

2,9306 

1,65 

,9050 

•1,0979 

,4827 

15,4 

22,50 

3. 0*’62 

1,48 

,9249 

• ,9604 

,6444 

15.6 

22,32 

3,2734 

1,31 

,9470 

• ,8414 

,9519 

15.8 

22.16 

3,4574 

1,17 

,9717 

*,7376 

1,7728 

16.0 

22,02 

3.6515 

1,03 

, V991 

",6471 

11,0242 

Column 

1 la  the 

ratio  r(l-l)Xi  / ECj 

Coluam  2 is  the 

estimate  for  the 

total  error  content 

Column  3 !■  the 

normed* estimate 

for  step  site. 

in  order  to 

determine  the 

actual 

estimate 

of  the  step  site 

, the  entry  in 

thle  column 

should  be  divided 

by  the  total  observation  tin*  T. 

Column  k Is  the  approximate  standard  deviation  of  the  estimate  of  the  total 
error  content. 

Column  5 is  the  normed  standard  deviation  of  the  estimate  of  the  step  site: 
in  order  to  obtain  the  actual  standard  deviation  the  entry  in  this  column 
should  be  divided  by  the  total  time  T. 

Column  6 is  the  normed  covariance  between  K and  in  order  to  obtain  the 
actual  estimated  covariance  the  entry  should  be  divided  by  I. 

Column  7 is  the  norned  HTTF  and  in  order  to  obtain  the  actual  va'ue  the 
entry  should  be  multiplied  by  T. 


131 


N s 23 


RATIO 

total 

erpop 

STF.  P 

sizi: 

VAR 

ERPOR 

VAR 

STEP 

CQVAH 

HTTP 

cs. 

• 

vH 

H 

23i. l5 

.1046 

1^20*33 

,7232- 

1.09S 

,9330 

, 0459 

11.4 

‘Stfi 

.209? 

379,58 

• ?74 

• 2511 

,0*86 

11  .6 

.3142 

1*8,19 

, 7 ?4  8 

-121 

,4035 

,0515 

11.# 

66,64 

, 4 1 94 

94,26 

, 7 ? 6 2 

,9556 

,0546 

12.0 

55.fi0 

.5252 

6C  ,03 

, 7281 

*43 

,2105 

,Q5ei 

12.2 

46,6? 

.6315 

41,43 

, 7303 

m?9 

,7610 

,0616 

12.4 

43,54 

,7387 

30,21 

, 7330 

*21 

,6495 

,0659 

12. A 

39,77 

,8465 

?Z,94 

, 7362 

*16 

,3968 

,0704 

12,  8 

36,67 

,9554 

17,95 

,7399 

•12 

,7914 

,0754 

13.0 

34.59 

1.1/55  « 

14,39 

, 7440 

■10 

,2158 

,0»1C 

13.2 

32.75 

1 » 176® 

11,75 

, 7 487 

*8 

,3101 

,0*72 

13.4 

3 1 . 23 

1 * 2^96 

9,74 

,7538 

* 6 

,8585 

,0942 

13.6 

29.93 

1 .*044 

8,17 

, 7593 

• 5 

,7238 

,1021 

13. a 

28,93 

1.5205 

6,94 

,7658 

*4 

,8344 

,1110 

14.0 

28, C4 

1,6307 

5,94 

,77*e 

• 4 

,1151 

,1212 

14.2 

27,27 

1,7595 

5,12 

,7803 

«3 

,5238 

,1330 

14.4 

26,62 

1.6525 

4,44 

,7887 

*3 

,0371 

,1*69 

14.6 

26,05 

2,006? 

3,87 

,7979 

*2 

,6314 

,1631 

14.8 

25.56 

2.1372 

3,39 

• 8 0 7 9 

■ 2 

,2869 

,1826 

15.0 

25,14 

2,2693 

2,99 

,*189 

•1 

,9952 

,2064 

15.? 

24,76 

2.4054 

2,63 

,*309 

•1 

,7444 

.2360 

15.4 

24,43 

2.5461 

2,33 

,6438 

*1 

,52o3 

,2740 

15.6 

24.15 

2 ,69c«i 

2,06 

,8583 

• 1 

,3404 

,3239 

15,8 

23.90 

2,0405 

1 ,63 

,1743 

• 1 

,1791 

,3*25 

16.0 

23.68 

2.9967 

1,63 

, 6 9 1 7 

*1 

,0365 

, 4V42 

16.2 

23,48 

3.1590 

1,45 

,9110 

A 

,9127 

,658* 

16.4 

23,31 

3,3287 

1.29 

,9323 

- 

(8040 

,9705 

16.6 

23,16 

3,5068 

1,15 

,9556 

% 

,7087 

1,7976 

16.8 

23.02 

3,6948 

1,03 

,9819 

*» 

,6242 

10,8617 

Column  1 la  the  ratio  rd-UXj  / IXj 

Column  2 la  the  estimate  for  the  total  error  content 

Column  3 la  the  normed*  estimate  for  step  sites  In  order  to  determine  the 
actual  estimate  of  the  step  size,  the  entry  In  this  column  should  be  divided 
by  the  total  observation  time  T. 

Column  U la  the  approximate  standard  deviation  of  the  estimate  of  the  total 
error  content. 

Column  5 la  the  normed  standard  deviation  of  the  estimate  of  the  step  size: 
in  order  to  obtain  the  actual  standard  deviation  the  entry  in  this  column 
should  be  divided  by  the  total  time  T. 

Column  6 Is  the  normed  covariance  between  H and  rf:  in  order  to  obtain  the 

actual  estimAed  covariance  the  entry  should  be  divided  by  T. 

Column  I Is  the  normed  MTTF  and  In  order  to  obtain  the  actual  va'ue  the 
entry  should  be  multiplied  by  T. 


132 


r 

i 1 w 

N s 

24 

t 1 

RATIO 

Total 

STtP 

VAR 

VAR 

C0VAR 

M1F 

T 

i ^ 

fcRROR 

S 1 2k 

PRWOR 

bTEP 

1 

1 

12.Q 

107.74 

, 2507 

27  0,02 

, 7069 

-190,9127 

, 0476 

12.2 

«8.5l 

.35j  3 

137,35 

,7100 

*97 , 0195 

, 0504 

12.4 

65,46 

,4524 

«2,73 

,7)14 

*56,3553 

,0533 

12.  A 

55,94 

.5536 

55.11 

,7133 

*36,6116 

, 0565 

12. d 

49.  J9 

,ft559 

39,21 

,7155 

•27,5582 

, 0600 

13.0 

44,63 

,75b  7 

29,23 

,7)60 

•20,4979 

,0639 

13.2 

41,04 

.8622 

22,58 

,7211 

•15,7893 

, 0681 

w' 

13.4 

36.23 

,9666 

17,91 

, / 246 

*12,4690 

,0727 

13.6 

35.99 

1,0721 

14,51 

, 7265 

-lo,qe23 

, 0776 

13.8 

34 .16 

1.1789 

31,95 

,7326 

*6,2736 

, 0035 

14.0 

32,65 

1.2372 

9,98 

,73/6 

*6 , 8 3 0 6 

, 069V 

14.2 

31.37 

l.oQ65 

8,44 

, 7431 

•5,7947 

, uv/o 

14.4 

3 0 , 31 

1.5082 

7,20 

, 7487 

*4,9146 

,1050 

14.6 

?9.4l 

1,6210 

6,20 

, 7552 

•4,2091 

,1141 

14.8 

26,6? 

1,7360 

5,37 

, 7623 

*3,62/3 

,1246 

15. C 

27.95 

1.6536 

4,68 

, 7699 

•3,1400 

,1367 

! 

15.2 

27,36 

1.9734 

4,10 

, 7782 

-2,7325 

,1507 

15.4 

26.85 

2. 0*57 

3,61 

, 7874 

-2,3883 

,1673 

15.6 

26.40 

2 • 22l  4 

3,l9 

,7973 

-2 , 09 13 

,1673 

I 

15.6 

26.01 

2.35o 4 

2,82 

,6080 

•1,8367 

,2115 

| 

16.0 

' 25,67 

2.4331 

2,51 

,8197 

•1,6158 

,<418 

. 

16.? 

25.36 

2.0190 

2,23 

,8328 

•1,4269 

, 2600 

16.4 

25.09 

2.7604 

1,99 

,6467 

*1,2581 

,3)11 

16.6 

24  ,86 

2,9064 

1.79 

.6622 

*1.1119 

,4012 

16.3 

24,65 

3.0577 

1,59 

,8791 

- ,9639 

,5040 

t w 

17.0 

24,46 

3,2156 

1,42 

,6977 

• ,67  03 

,6708 

17.2 

24.30 

3 , 36  o5 

1»27 

, 9 1 8 1 

• . 77  01 

, 9 h / 5 

17.4 

24.15 

3,5532 

1.14 

,9406 

-,6818  1 

,6211  " 

! f 

17.6 

24.03 

3,7348 

1,02 

,9655 

*,6038  10 

, 2V  7 7 

\ 

Colusa  1 Is  the 

ratio  r(i-l)X1  / IXt 

_ . 

Column  2 Is  the 

estimate  for  the 

total  error 

content 

! f 

Column  3 Is  the 

normcd*  estimate 

for  step  size: 

ln  order 

to  determine  the 

ectual  estimate 

of  the  step  size 

, the  entry  : 

Ln 

this  column  should  be  divided 

by  the  total,  observation  time  T. 

| 

Column  4 Is  the  approximate  standard  deviation 

of  the  estimate  of  the  total 

1 - 

error  content. 

r 

Column  5 Is  the 

noraed  standard 

deviation  of 

the  estimate 

of  the  step  size: 

1- 

In  order  to  obtain  the  actual  standard  deviation  the  entry  in  this  column 

\ 

should  be  divided  by  the  total  time  T. 

W 

Column  6 le  the 

noraed  covariance  between  K and  8:  In  order  to  obtain  th» 

1 I 

actual  estimated  covariance  the  entry  should 

be  divided  by  T. 

r 

Column  T la  the 

norned  HTTP  and 

in  order  to  obtain  tba  actual  va'.ua  tha 

1 V 

entry  should  be  multiplied  by  T. 

i 1 
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N s 25 


RATIO 

total 

fcRRon 

GTfc-P 
s i z r. 

VAR 

ERROR 

VAH 

STEP 

cova« 

r I t f 

12.2 

272.14 

• 0*762 
. 1 '7  2 4 

1673,60 

,6935" 

1?90,89O4 

, 0421 

• * 

12.4 

142.32 

467,89 

,9940 

*324,2377 

, 0443 

12.6 

99,14 

,2089 

207,42 

6948 

-143,6)65 

,0467 

,0493 

12.6 

77.63 

.3056 

116,28 

,6959 

-00,4249 

w 

13.0 

64, 60 

, 4 8 ? 6 

74,15 

,o976 

-51,2273 

, 0521 

13.? 

56,29 

.5102 

51,22 

,6993 

-35,3237 

, 0551 

13.4 

5 0 , 25 

,6784 

37,39 

, 7 0 1 4 

-25,7297 

, 0504 

13,6 

45.77 

.7770 

28,43 

,7041 

.7069 

"l9,524e 

,0»20 

,U&59 

13.6 

42.3? 

,e7b6 

22,2« 

"16,2564 

14.0 

39,59 

.9769 

17,89 

,7103 

-12,2157 

, 0702 

14,2 

57.38 

1.C785 

14,63 

,7139 

•9,9536 

, 0 749 

14.4 

35,57 

1.1010 

12,15 

,7179 

•8,2305 

,0^01 

14,6 

34,06 

1,2046 

10,23 

, 7226 

-6,9084 

,0059 

14.  A 

32.79 

1.3896 

8,71 

,/?7  6 

-5,8544 

,0924 

15.0 

31.70 

1.4966 

7,47 

, 7328 

•4,9946 

, 0957 

15.2 

30.78 

1.6C49 

6,46 

,7388 

•4,2973 

,iu79 

w 

15.4 

29,98 

1.7J40 

5,63 

, 7454 

-3,7237 

,1171 

15.6 

29.20 

1.8271 

4,93 

, 7524 

•3,2395 

,1278 

15.6 

25.68 

1,9412 

4,34 

, 7602 

"2,8239 

,1400 

X 

16.0 

28.15 

2,0580 

3,63 

, 7689 

"2,4060 

,1544 

16.2 

?7 , 66 

2,1775 

3,40 

, 7775 

-2 , ie  7i 

,1713 

16.4 

27.27 

2.3001 

3,02 

, 7fl72 

-1,9282 

,1916 

>m 

16,6 

26.91 

2 , 4?50 

2,69 

2,40 

2,15 

, 7976 

•1,7041 

,2163 

16, n 

26,59 

2,5548 

,8094 

rl,5094 

,2469 

17.0 

26,33 

2,6877 

,8221 

-1,3368 

, 2859 

W 

17.2 

26,05 

2,8254 

1,93 

,8357 

•1,1870 

,3376 

17,4 

25,83 

2,9472 

1,73 

,6508 

*1,0553 

,4083 

17.6 

25.63 

3,1147 

1,55 

,«671 

-,9375 

,5126  * 

17. 6 

25,45 

3.2682 

1,40 

,8850 

-,8331 

, 6eQ9 

10  . 0 

25,29 

3,4283 

1,24 

,9046 

7 4 o® 

, 9 Vc2 

18,? 

25 , lK 

3 , 5°6  0 

1,13 

,9?62 

-.6583 

1,8*70 

18.4 

25. C3 

3.77)7 

1.01 

,9499 

•,5e58 

5.3922 

Column  1 la  the  ratio  £(l-l)Xt  / £Xj 

Column  2 is  the  eatlmate  for  the  total  error  content 

Column  3 la  the  normed* eatlmate  for  atep  alxe:  In  order  to  determine  the 

actual  eatlmate  of  the  atep  alze,  the  entry  in  thla  column  ahould  be  divided 
by  the  total  obaervatlon  time  T. 


t 

I 

i 

] 

I 


Column  4 la  the  approximate  atandard  deviation  of  the  eatlmate  of  the  total 
error  content. 

Column  5 la  the  normed  atandard  deviation  of  the  eatlmate  of  the  atep  alee: 
In  order  to  obtain  the  actual  atandard  deviation  the  entry  in  thla  column 
ahould  be  divided  by  the  total  time  T. 

Column  6 la  the  normed  covariance  between  N and  4:  In  order  to  obtain  the 

actual  eatlmated  covariance  the  entry  ahould  be  divided  by  T. 

Column  7 la  the  norned'  KTTT  and  In  order  to  obtain  the  actual  va'.ue  the 
— ahnuld  he  multlnlied  bv  T. 
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ratio 

TOTAL 

nuRof-' 

6TL P 
S ! 

VAR 

FRMOH 

VAH 

bTt.P 

CQVAK 

MTTf 

13.  o 

125,40 

.2313 

330,06 

,6808 

•224,2022 

, 0435 

• 13.2 

93.4? 

.3241 

167,99 

, 68 1 7 

•114,0230 

, U456 

13.4 

75.72 

,4172 
« 51 C 7 

101,28 

,6829 

-6b,6?(j5 

,V*82 

13.6 

64.51 

67,49 

,6044 

•45,69q8 

, 0508 

13.(i 

5o  , 6 3 

.6046 

46,07 

,68fc2 

•32,4853 

, 0537 

14. C 

51.1* 

.6991 

35,88 

,6863 

•24,2005 

, 0568 

14.? 

40.94 

, 794? 

27,74 

,69q7 

-18,6666 

, DOC  1 

14,4 

43.62 

,er,99 

22,04 

.6936 

•14,7568 

•11,9618 

, 0638 

14.6 

40,9* 

,9“66 

17,67 

,6966 

, 0678 

14. P 

36.78 

1.0642 

14,75 

. /cci 

•9,8426 

, 0722 

15. C 

36,98 

1,3826 

12,36 

,7041 

•8,2155 

, 077  a 

15.2 

35,47 

1,2*24 

1G  ,47 

, / 003 

•6,9311 

,0623 

15.4 

34.19 

1,3836 

£,95 

,712* 

• 5 ,9020 

,0Wt2 

15.6 

33.10 

1,4857 

7,73 

6,72 

,7161 

*5,0726 

, QV48 

15.  e 

32,15 

.1,5896 

, 7235 

-4,3850 

,1022 

16.0 

31.34 

1,6953 

5,88 

,7296 

- 3 , 8 J 5 8 

,1109 

16.2 

30.62 

1.6027 

5,17 

,7361 

-3,3350 

,1200 

16.4 

30.00 

l,9l?l 

4,56 

, 7432 

-2,9274 

,130« 

16.6 

29,45 

2.0236 

4,05 

, 7508 

-2,5795 

,1433 

,1579 

,1750 

16,6 

26.96 

2,1377 

2,60 

, 7591 

-2,2764 

17.0 

?e,53 

2,2541 

3,21 

, 7661 

-2 , oae5 

17.? 

26,15 

2,3737 

2,87 

, 7777 

ml, 7509 

,1956 

17.4 

27.62 

2,4959 

2,58 

, 7083 

-1,5935 

,2*05 

17,6 

27,52 

2,622? 

2,32 

, 7995 

-1,4173 

•1,2630 

,2516 

17,6 

27.25 

2,75l9 

2,00 

,8U9 

,2912 

16,0 

27,01 

2,6662 

1,87 

,6251 

-1,1250 

,343o 

18.2 

26,60 

3,0247 

1,69 

1,52 

,8396 

•1,0035 

,4154 

18,4 

26.61 

3,1680 

,8556 

-,8964  ' 

,5200 

IB , 6 

26,44 

3,3175 

1,37 

,8728 

*,7996 

,6895 

18.8 

26,29 

3,4729 

1,24 

1,12 

,8918 

*,7142 

1,0052 

19.0 

26,15 

3, 6760 

.9123 

* , 6369 

1,0243 

19.? 

26,03 

3,6067 

1,01 

,9350 

*,5669 

8,7326 

Column  1 is  the  ratio  JI(  i-UXj/TXj 

Column  2 Is  the  estimate  for  the  total  tYrror  content 

Column  3 is  the  nomed  estimate  for  step  site:  in  order  to  determine  the 
actual  estimate  for  the  step  size,  the  er* -y  in  this  column  should  be  divided 
by  the  total  observation  time  ?. 


Column  U is  the  approximate  standard  deviation  of  the  estimate  of  the  total 
error  content. 


Column  5 is  the  normed  standard  deviation  of  the  estimate  of  the  step  size: 
in  order  to  obtain  the  actual  standard  deviation  the  entry  in  this  column 
should  be  divided  by  the  total  time  T. 

Column  6 is  the  normed  covariance  between  II  and  $:  in  order  to  obtain  the 

actual  estlnatcd  covariance  the  entry  should  be  divided  by  T. 

Column  7 is  the  normed  WITF  and  in  order  to  obtain  the  actual  value  the 
entry  should  be  multiplied  by  T. 
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N t ?7 


RATIO 

total 

SUP 

var 

VAR 

cqvah 

MTTF 

PRRCR 

S T 2 F 

pRRQR 

STEP 

13.2 

316.49 

.089c 

2272,37 

,6672- 

1515,7236 

,0368 

13.4 

164,99 

t:7«i 

567,54 

,0477 

-370,4439 

, 0407 

13.6 

114.59 

i 2**74 

25^,67 

,6683 

•167 , 6967 

,0427 

13.0 

»9, 47 

• 356H 

1 4 1 , 1 9 

, 069  J 

m93,99yH 

, 0449 

14. C 

74.47 

,4465 

90 . 1)6 

,°7o6 

.59,8099 

, U 4 7 2 

14.? 

64 ,5i 

,5367 

62,25 

,8720 

.41,3342 

,0497 

14.4 

57,44 

,6?73 

45,48 

,6737 

.30,1483 

,0524 

14. 1 

52.19 

.7183 

34,62 

,6759 

-22,9073 

, 0553 

14.6 

48.14 

.8099 

27, 17 

,6783 

.17,9354 

, 0584 

15 . 0 

44,93 

i 9 f,  2 2 

21,04 

,6810 

•14,3623 

,0618 

15,2 

42.32 

,9955 

17,89 

,0039 

-11,7425 

, 0636 

15.4 

40.18 

1.0896 

14,83 

,0871 

-9,7380 

, 0o9  ft 

15.6 

38 , 39 

1.1945 

12,55 

,o9ce 

•0,1«26 

, 0741 

15.8 

36 , 68 

1.280© 

10,70 

,o9a8 

-6,9481 

, 079(1 

16,0 

35.60 

1.3776 

9,21 

,6992 

•5,9559 

, 0444 

16,2 

34.49 

1.4761 

7,93 

. '040 

•5 , I4l5 

,0904 

16.4 

33.54 

1.5757 

6,97 

,'093 

-4,4716 

, 0971 

16.6 

32.70 

1.6773 

6,12 

. ' 1 4 e 

•3,9026 

,1046 

16.8 

31.97 

1.7804 

5,40 

.'200 

•3,4237 

,1131 

17.0 

31.3? 

L.8951 

4,79 

, 7274 

•3,0199 

,1227 

17.? 

30.76 

1.99jd 

4,26 

,'345 

•2, 6718 

,1337 

17.4 

3C.25 

2 1 1 G 0 9 

3,81 

,7420 

■2 , 36Q2 

",1464 

17.6 

29.80 

2.2125 

3,41 

,7501 

•2,1036 

17.8 

29,41 

2.3261 

3,06 

, 7591 

•1,8757 

,1786 

18.0 

29.05 

2.4431 

2,75 

, 7685 

-1 1 6 7 1 e 

,1993 

16.2 

28.74 

2. 5628 

2,48 

,7788 

.1,4933 

,2249 

18.4 

28,45 

2,6854 

2,24 

,'901 

•1,3370 

,2361 

18.6 

28.20 

2,8121 

2,02 

,0021 

•1,1966 

,2960 

18.8 

27.97 

2,9431 

1,83 

,8150 

•1,0704 

,3489 

19.0 

27,77 

3,0780 

1,65 

,0292 

-,9596 

, 4208 

19.2 

27.59 

3,2184 

1,50 

,0444 

-,8585 

,5274 

10.4 

27,43 

3.3637 

1,36 

,8611 

-,7695 

,6963 

19,6 

27,28 

3,5148 

1,23 

,0794 

• , 6 V C2 

1,0096 

19.0 

27,15 

3,6731 

1.11 

,0992 

-.6181 

1 ,6055 

20. C 

27,03 

3,8386 

1,01 

,9209 

•,5539 

7,7113 

Column  1 is  the 

ratio  E(i-l)> 

!i/Ixi 

V 

Column  2 is  the 

estimate  for 

the  total  hrror  content 

Column  3 is  the 

normed  estimate  for  step  size: 

in  order 

to  determine 

the 

actual  estimate 

for  the  step 

size,  the  entry  in 

this  column  should  be 

divided 

by  the  total  observation  time  T. 


Column  It  is  the  approximate  standard  deviation  of  the  estimate  of  the  total 
error  content. 

Column  5 is  the  normed  standard  deviation  of  the  estimate  of  the  step  size: 
in  order  to  obtain  the  actual  standard  deviation  the  entry  in  this  column 
should  be  divided  by  the  total  time  T. 

Column  6 is  the  normed  covariance  between  II  and  ♦:  in  order  to  obtain  the 

actual  estimated  covariance  the  entry  should  be  divided  by  T. 

Column  7 Is  the  normed  MTTF  and  in  order  to  obtain  the  actual  value  the 
entry  should  be  multiplied  by  T. 
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N s 2fi 


t 


RATIO 

total 

SiTl-P 

VAR 

VAR 

cgvAR 

fcHROR 

i;  I zn 

r-KRQR 

b T fcP 

1^.0 

144.39 

.2147 

397,42 

,6558 

-260,1252 

,0400 

14.? 

ld7  ,?8 

.300° 

202,39 

,6566 

"132,3920 

,041V 

14.4 

86.71 

,3372 

122,04 

, 0 5 7 © 

*79,7458 

, 0440 

14  .6 

73.7ft 

.4738 

81.42 

, 6588 

*53,1448 

, 0462 

14  ,e 

64.73 

. 56  0® 

58,02 

,6603 

*37,8104 

, 0486 

IS.  0 

58.19 

, h 4 8 3 

43,34 

,6620 

-28,1974 

,0511 

lb. 2 

53.  ?S 

,7362 

33,55 

,6641 

•21.7839 

,0536 

15.4 

49.35 

, S?4  7 

?6,67 

,6663 

-17,2794 

,0568 

15.6 

46,24 

.9138 

21.67 

,6690 

-14,0057 

,y«uu 

15.8 

43.7q 

1. 0036 

17,92 

,67i« 

•11,5468 

, 0635 

16 . 0 

41.59 

1.0943 

15,02 

,6750 

•9,6*22 

, 0»73 

16.? 

39,61 

1 ♦ 1 8©0 

12.75 

,6704 

-6,1616 

,0714 

16.4 

38,30 

3. . ?786 

3 0,92 

.8821 

*6,9691 

, 075V 

16.6 

37,01 

1.3721 

9,45 

,6ft6J 

*6,0059 

,0609 

16. B 

35.69 

1,4671 

8,23 

,6907 

•5,2068 

, 0664 

17.0 

34.93 

1.563C 

7,22 

,6957 

-4,5475 

, 0925 

17.2 

34,06 

1 ,66f6 

6,38 

, 7 0 0 9 

•3,9082 

, 0993 

17.4 

33,31 

1,7595 

5,64 

, 7065 

■3 , 5} 48 

,10/0 

17.6 

32.65 

1 ,86o4 

5,01 

,712? 

*3,1070 

,1156 

17.0 

. 32.07 

1 . 9 6?fl 

4,48 

.7191 

•2,7587 

,1253 

18.0 

31,55 

2,0670 

4,01 

, 7262 

-2,4*62 

,1364 

18.? 

31.  C« 

2,1737 

3,60 

,7337 

•2,1901 

, i 4 9 3 

18.4 

30.67 

2 , 28?4 

3,24 

,7419 

*1,9581 

,1642 

18,6 

30. 3C 

2,3942 

2,92 

, 7504 

-1,7509 

,1620 

18.8 

29,96 

2,5081 

2,64 

, 7598 

*1,5697 

,203n 

19.0 

29,67 

2,6251 

2,39 

, 7700 

•1,4088 

,2286 

19.2 

29,40 

2,745? 

2.4-7 

, 7809 

•1,2656 

,2603 

19.4 

29.16 

2,0687 

1.97 

, 7927 

•1,1380 

,3004 

19.6 

26,94 

2 ,99 ©5 

1.79 

,8053 

-1,0225 

,3534 

19.8 

25,75 

3 , 1?84 

1,62 

,8190 

*,9192 

,42ft! 

20.0 

28.58 

3,2650 

1.47 

,6339 

*,8266 

,5318 

20 .2 

2e.4? 

3,4069 

1.34 

,6500 

-.7428 

,7010 

20.4 

28.28 

3,5543 

1,22 

,6675 

-,6678 

1,0131 

20.6 

28,15 

3,7080 

1,11 

,6866 

- , 6006 

1,7631 

20,8 

28,04 

3.6689 

1,00 

,9073 

-,5399 

6,9537 

Column  1 is  the 

ratio  Ed-ltXj/iXj 

Column  2 is  the 

estimate  for  the 

total  £rror  content 

Column  3 is  the 

normed  estimate 

for  3tep  size: 

in  order 

to  determine  the 

actual  estimate  for  the  step  size,  the  entry  in  this  column  should  he  divided 
by  the  total  observation  time  T. 

Column  1*  is  the  approximate  standard  deviation  of  the  estimate  of  the  total 
error  content. 

Column  5 is  the  normed  standard  deviation  of  the  estimate  of  the  step  size: 
in  order  to  obtain  the  actual  standard  deviation  the  entry  in  this  column 
should  be  divided  by  the  total  time  T. 

Column  6 is  the  normed  covariance  between  II  and  in  order  to  obtain  the 
actual  estimated  covariance  the  entry  should  be  divided  by  T. 

Column  7 is  the  normed  11TTF  and  in  order  to  obtain  the  actual  value  the 
entry  should  be  multiplied  by  T. 
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RATIO 

TUTAL 

f : R R 0 P 

STfc'P 

S17F. 

war 

i:rhor 

vaR 

step 

cqvar 

0T1p 

14.2 

364, i7 

. Ofi29 

2 7 1, 0 , 2 0 

,6438' 

1/49,4325 

, 0360 

14.4 

1*9.31 

. 1 6 5 8 

678,65 

,6441 

•436,5859 

, 0376 

14.6 

131.1* 

,24fa8 

3ni,i« 

,644* 

•l93,64j0 

.,03*3 

14.8 

102,14 

.3320 

1 6 9 , 0 3 

,6455 

•100,6126 

,0412 

15.0 

84.8o 

.4155 

107,8-3 

,6465 

•69,2094 

, 0431 

15.2 

73,29 

,4993 

74,58 

,6477 

• 47 ,8043 

,0452 

15.4 

65,ii 

.5834 

54,54 

,0492 

■34 ,9j.q6 

, 0475 

15,6 

59 , 02 

,6678 

41,55 

,6509 

-26,5475 

,049V 

15.8 

54,3? 

,7528 

32,63 

,f>529 

•20,8124 

,0525 

16.0 

50.59 

,8384 

26,25 

,6551 

• 16 , 7 06  4 

,0552 

16.2 

47,57 

.9245 

21,54 

,6576 

•13,6708 

,0503 

16.4 

45,08 

1,0113 

17,95 

,6603 

•11,3639 

,0615 

16.6 

42.99 

1.0p90 

15,15 

,6633 

•9,5624 

,0651. 

16,8 

41,2? 

1,1074 

12,94 

,6666 

•0 1 14 l3 

,0689 

17.0 

39,7? 

1,2767 

11,16 

,6703 

•6,9937 

, 0731 

17.2 

30,41 

1,3671 

9,69 

,6741 

• 6 , 05l3 

, 0777 

17.4 

37.28 

1.4587 

8,47 

,6782 

•5,2688 

,0»28 

17.6 

36,30 

1.55H 

7,46 

,68?9 

•4 ,62{|9 

,u0e4 

17.6 

35.43 

1,6454 

6,60 

,6876 

•4,0652 

, 0946 

18.0 

34,66 

1 .7405 

5,87 

,6930 

•3,5979 

,1015 

18.2 

33,99 

1,6371 

5,24 

,6988 
, 7047 

•3 j i960 

,1092 

18.4 

33,38 

1.9358 

4,69 

•2,8434 

",  1 1 7 9 

18.6 

32,64 

2 , 0 3 b 1 

4,21 

,7112 

•2,5302 

,1278 

18,8 

32,36 

2.1379 

3,80 

.7183 

•2,2741 

,1390 

19.0 

31,93 

2.2423 

3,43 

,7257 

•2,0378 

,1521 

19,? 

31.55 

2,3467 

3,10 

, 7338 

•1,8306 

,1672 

19.4 

31,20 

2,4576 

2,81 

,'424 

•1,6465 

,1049 

19.6 

30.69 

2.5696 

2,55 

,'515 

•1,4005 

,2064 

19,8 

30.61 

2,6833 

2,32 

,/6i5 

•1,3345 

,2321 

*0.0 

3C.35 

2,bOl6 

2,11 

,'721 

•1,2026 

,2641 

20.2 

30.12 

2,9322 

1,9? 

,'837 

•1,0855 

,3045 

20.4 

29 , 9? 

3 , 04»9 

1.75 

, '960 

-,9792 

,3576 

20.6 

29,73 

3.1760 

1,59 

,«092 

•,ee?8 

,4307 

20.8 

29,56 

3.3C91 

1.45 

,8237 

-.7969 

,5360 

21.8 

? 9 , 4 1 

3,4473 

1,32 

,0393 

• , 7l69 

, 7034 

21.2 

2 9,28 

3, 59i2 

1.21 

,0561 

•,0479 

1,0117 

21.4 

29,15 

3,7406 

1,10 

,0745 

•,5849 

1,7511 

21.6 

29.04 

3,6970 

1,00 

,0944 

-.5275 

6,1691 
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N 

s 30 

1 

PATIO 

totai. 

STHP 

VAR 

VAH 

COVAH 

MTTP 

lrror 

SI  Zlt 

FRROR 

STEP 

1 

15.0 

164.72 

. 2004 

472,50 

,6334 

-298,7872 

, 0370 

15.2 

122,0’ 

, 28 0 7 

240,70 

,9341 

•152,1264 

,0387 

15.4 

98,46 

. 3612 

145,22 

,6349 

,.91,6995 

, 0404 

15.6 

«3.49 

.<♦419 

96,92 

,6360 

•61,1410 

, 0423 

w 

15.8 

73.1? 

,5230 

69,11 

,0372 

•43,5380 

, 0443 

16.0 

6>?. 64 

,6Q44 

51,66 

, 6.1t>6 

•32,49*5 

, 0464 

16,2 

59,92 

,6861 

40,02 

,0404 

• ?5 ,1303 

, OAe  7 

‘ w 

16,4 

55.44 

, 7664 

31,84 

,6422 

•19,9555 

, U512 

16.6 

51.84 

,88i2 

?5,89 

,6444 

-16,1929 

,0538 

16.5 

48,90 

,9346 

21,43 

, 6468 

• 13 , 36  70 

, 0566 

w 

17,0 

46,45 

1.0185 

17,99 

,6494 

•11,1952 

,0597 

17,2 

44.40 

1. 1031 

15,30 

,6524 

-9,4922 

, 0630 

17.4 

42.64 

1.3887 

13,13 

,6555 

-8,12i7 

, 0666 

17.6 

41.13 

1 ,2750 

11,37 

,6589 

-7,0113 

, 0 7 0.5 

17.8 

39,82 

1,3625 

9,9? 

,6625 

"6  i O’ J.7 

, 0748 

18.0 

38,68 

1.4505 

8,72 

,6666 

•5,3363 

, 0794 

w 

18.2 

37,68 

1,5401 

7,70 

,6708 

•4 ,69U 

, 0646 

18.4 

36,60 

1.6304 

6,64 

,o755 

•4,1501 

,1)902 

18.6 

36. C2 

1,7227 

6,10 

, 6803 

-3,6765 

, 0965 

1 J 

18.8 

35,32 

1,8361 

5,46 

,6855 

•3,2745 

,1035 

19.0 

34,70 

1.9108 

4,90 

,6?i2 

•2,9256 

,1113 

19.2 

34.15 

2,0070 

4,42 

,0973 

-2,6213 

,1201 

19.4 

33.65 

2,1054 

3,99 

,7n37 

•2,3517 

,1302 

19.6 

33,20 

2,2055 

3,61 

,75  06 

•2,1145 

,1416 

19,8 

32,80 

2,3071 

3,28 

,7182 

•1,9071 

,1546 

w 

20.0 

32,44 

2,4114 

2,98 

, 7261 

.1,7199 

,1699 

20,2 

32,11 

2,5179 

2,71 

,7346 

•*,5536 

,1878 

20. A 

31,62 

2,6274 

2,47 

,7436 

•1,4029 

,20*3 

20.6 

31,55 

2,7395 

2,25 

,7533 

•1,2662 

,2354 

20.6 

31.31 

2,6546 

2,05 

,7637 

•1,1469 

,2676 

21.0 

31,09 

2.9726 

1,88 

,7750 

•1,0391 

,3080 

— 

21.2 

30,89 

3,0945 

1,72 

, 7870 

•,9403 

,3613 

21.4 

30,72 

3,2206 

1.57 

, 7999 
,613’ 

• , 85  06 

,4343 

21.6 

3C.55 

3,3507 

1,43 

-,7700 

,5393 

• *+* 

21.  f- 

30.41 

3,4856 

1,31 

,8289 

• , 6968 

, 7050 

22.0 

30,27 

3,6259 

1,20 

,6451 

-,6298 

*,0075 

f 
• » 

22.2 

30.15 

3,7716 

1,10 

.6628 

• , 57  01 

1,7187 

• 

22.4 

30. C5 

3,9237 

1,00 

,«8l9 

•,5156 

5,5675 

t- 
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RAT  JO 

totai, 

furor 

STEP 

sizt 

VAR 

ERROR 

va« 

STEP 

CQVA0 

MTIF 

15.2 

415.14 

. 0775 

3211,43 

,0226- 

j99P , 8 o55 

, 0336 

l5.4 

215.32 

, l55i 

Ssi# 

199,83 

,6?  29 

•499,2111 
• 221 ,437/ 
"124,1987 

, U J5n 

15.6 

1*8,62 

,2327 

, °234 

,0365 

15. 6 

115,64 

.3lC5 

,6240 

, 0361 

16 . 0 

95,79 

,3085 

127,53 

,6?40 

-79,1855 

,UJ«7 

16.2 

*2.6? 

,4667 

06,2° 

,6?59 

•54,76i7 

,0413 

16,4 

7 3.26 

,5452 

64 ,60 

.0272 

-40,0192 

, 0434 

16.6 

66.27 

,6241 

49,23 

,0286 

"30,4491 

, 0454 

16.8 

6q,B3 

,7  033 
.7030 

3e  ,69 

,630* 

"23,8927 

, 0476 

17 .0 

56,59 

31, 16 

,6321 

"19,2066 

, 0499 

17.2 

53.11 

25,50 

,6342 

"15,7294 

,0524 

17.4 

5c, 24 

,9439 

?1,35 

,6365 

"13,0968 

,0351 

17.6 

47,64 

1.0253 

18 ,05 

,0390 

•11,0419 

, 0 3 V 9 

17. n 

45,80 

1,1071 

15,43 

,0419 

-9,4189 

,0M0 

18.0 

44 , C5 
42,54 

1,1099 

13,32 

, 6448 

•8,1028 

, 0944 

18.2 

1,2737 

11,58 

,0479 

•7,0216 

,0680 

10.4 

41.23 

1,3579 

10,16 

,0515 

"6,1363 

, 0 720 

18,6 

40. 00 

1,4433 

8,96 

,6553 

• 5 , J9  Cl 

, 0763 

18.0 

39.06 

1,5298 

7,94 

,6593 

-4,7578 

,0911 

19,0 

38.17 

1,6170 

7,03 

,6638 

•4,2232 

, 0862 
, 0920 

19.2 

' 37,37 

1.7Q6C 

6,32 

,0682 

"3,7561 

19.4 

36.66 

1,7961 

5,68 

,6732 

•3,3542 

, 0984 

19.  f 

36.03 

1,8871 

5,12 

,0786 

•3,0007 

,1054 

19,6 

35,46 

1.90C1 

4,62 

,0842 

,6901 

•2,7013 

,1133 

20.0 

34,94 

2,0743 

4,18 

•2,4298 

,1223 

20.2 

34,46 

2,l7o9 

3,80 

,0966 

"2 , l$l5 

,1324 

20.4 

34,06 

2,2669 

3,45 

, 7035 

•1,9001 

,1439 

20.6 

33,69 

2,3605 

3,15 

,7J09 

-1,7930 

,1570 

20.8 

33.34 

2,47i2 

2,87 

,7185 

-1,6207 

,1726 

21  ,0 

33,04 

2,5752 

2,62 

,7?  70 

-1,4708 

,1906 

21 .2 

32.76 

2,oR?2 

2,40 

2,19 

,7339 

-1,3339 

,2121 

21.4 

32.50 

2,7920 

, 7454 

•1,2099 

,2383 

21.6 

32.27 

2,9044 

2,01 

, 7557 

-1,0986 

,2704 

21,0 

32.06 

3,0207 

1,84 

, 7665 

- 1 9958 

,3116 

22.0 

31,67 

3.14C1 

1,69 

, 7782 

-,9037 

,3951 

22,2 

31,70 

3,2620 

1,55 

,7909 

• , 8213 

, 4372 
,3422 

22.4 

31,54 

3,3002 

1,42 

, 8043 

-.7449 

22.6 

31,40 

3, 5219 

1,30 

,»189 

- 1 6761 

, 7062 

22.8 

31,27 

3 , 6 c 6 5 

1119 

,8347 

-,613b 

,9997 

23, C 

31,16 

3.8CG0 

1,09 

,8516 

*,5561 

1,6853 

23,2 

31.  C5 

3,9490 

1,00 

,8699 

-.5044 

5,0304 

140 
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ratio 

TOTAL. 

fcRPOH 

F.Tf-P 

sizt- 

V AM 
FRKOH 

VAH 

STfc.P 

C0VAR 

MfTf 

16 . 0 

106.39 

,107b 

555,52 

.9132 

■340,137? 

, 0345 

16,? 

137,00 

,2630 

203,04 

,9130 

*173,2259 

, 035  V 

16.4 

110.90 

,3365 

170,03 

,6145 

•104,4742 

, U 3 / 4 

16.6 

93,00 

,4141 

114,04 

,6154 

*69,6793 

, 0356 

16.  A 

02,12 

,4099 

Bl  i 37 

,0164 

*«49 ,6601 

, 040  7 

17.0 

73,53 

,5661 

60,06 

,6176 

•37,0894 

, 0425 

17.2 

67 ,00 

,6  425 

47,17 

,6191 

*28,7069 

, 0445 

17.4 

61.60 

,7194 

37,56 

,o?06 

*22,0142 

,0*05 

17.6 

57,77 

,7966 

30,53 

,6225 

*18,5415 

, 048  7 

17.0 

54.39 

,0744 

25,32 

,6245 

-15,3198 

,0511 

lfl.O 

51.59 

,9527 

21,28 

,6267 

*12,8491 

, 0536 

IB,? 

49,22 

1 , 0 3 1 5 

18, U 
15,56 

,0292 

*10,9049 

, 0563 

IB. 4 

47,20 

.1,1111 

,6317 

-9,3428 

, 0552 

10.6 

45,46 

1 . 1 9 1 1 

13,50 

,6347 

-0,0845 

, 0623 

10.0 

43,96 

1,2720 

U.80 

,6378 

-7,04^7 

, 0057 

I’.O 

42,64 

1.3030 

10,30 

,6411 

-6,1751 

, 0054 

IV. 2 

41.47 

1,4367 

9,lfl 

, 6445 

*5,4392 

, 0735 

19,4 

40,45 

1 ,5?q2 

8,17 

, 6484 

•4,8203 

,0/79 

19.6 

39,54 

1 .6046 

7,30 

,6526 

*4,2528 

,0026 

19.0 

38,73 

1,6906 

6,55 

,6568 

-3,0302 

, 0079 

20,0 

38,  Cl 

1.7772 

5,90 

.6616 

•3,4346 

,0937 

20.2 

37,35 

1.G655 

5,33 

,6665 

-3,oe46 

,1001 

20.4 

36,77 

1 ,9551 

4,8? 

,6710 

-2,7780 

,1073 

20.6 

36,24 

2,0460 

4,38 

,6774 

•2,5002 

,1153 

20.0 

35,76 

2,1385 

3,98 

,0035 

-2,2686 

,1242 

2 1 . 0 

35,33 

2.2331 

3 b 63 

,6497 

*2,0530 

,1345 

21.2 

34,94 

2,3?9i 

3,31  .. 

,6966 

-1.8624 

... ,1<6J  . 

21.4 

34,50 

2, 4272 

3,03 

2,78 

, 7038 

• 1 . 69  Q4 

,1594 

21.6 

34.26 

2, 5269 

,7116 

.1,5379 

,1748 

21.8 

33,97 

2,6295 

2,54 

,7198 

*l,397e 

,1931 

22.0 

33,70 

2,7340 

2,33 

2,14 

, /?04 

•1,2700 

,214V 

22,2 

33,46 

2,64?2 

, 7377 

-1,1561 

,2412 

22.4 

33,24 

2,9522 

3,0660 

1,97 

, 7478 

-1,0532 

,2733 

22.6 

33. C4 

1,81 

, 7584 

-,957e 

,3145 

22.0 

32.05 

3,1027 

1,66 

, 7698 

-.8722 

,36/7 

23.0 

32.69 

3,3C29 

1,53 

. 7821 

-,7943 

,4396 

23.2 

32.54 

3,4272 

1.40 

, 7953 

-.7230 

,5433 

23.4 

32.40 

3.555B 

1,29 

,8094 

-,6581 

, 7041 

23.6 

32.27 

3,6096 

1 a 19 

,6245 

«,597e 

,9930 

23.9 

32.16 

3 , B?8l 

1,09 

,0409 

-.5439 

1,6*11 

24.0 

32.06 

3,9724 

1,00 

,0505 

-.4948 

4,5225 

N e 3.1 


MAT  i n 

total 

f rpor 

srtP 

S!7F: 

VAR 
ft  R M G M 

VaR 

5TfcR 

COVA0 

nj  T 8 

16,2 

469.51 

.07?8 

3 7 r'  6 , 5 1 

, 6034- 

?266,lP70 

,0315 

\ .*  1 6 . 4 

242.97 

. 1456 

930,11 

,°036 

-565,732’ 

, 0327 

16,6 

167,59 

,2166 

416,50 

,6p40 

-251,0045 

,0340 

16, a 

129,9ft 

.2916 

233,86 

, 6046 

-I4u,’0l4 

,0354 

17,0 

lu7 , 47 

,3646 

149,31 

,6053 

-09,8832 

, 0360 

17.2 

92,21 

,436? 

.5118 

103 ,30 

,6002 

-62,1731 

, 0363 

17.4 

81.88 

75,69 

,°073 

-45,4670 

, 0400 

w 

17,6 

73.94 

,5*57 

57,70 

,6085 

•34,6156 

,041' 

17  .R 

67,81 

.6899 

45,40 

,6100 

-27,15/6 

,0435 

18 . 0 

62.93 

.7345 

36,58 

,6115 

-21,87x8 

, Q455 

18.2 

58,96 

.5096 

30,05 

,6133 

-1 7,9360 

, 0476 

18.4 

55,69 

,£849 

,94o9 

?5,10 

,6153 

-14,5532 

, 0498 

18.6 

52.94 

21,24 

,6174 

-12,6255 

, 0522 

18.8 

50.61 

1.0375 

10,17 

,6197 

-1U.772H 

, 0547 

l’.O 

48.61 

i • 1 J 4 5 

35,71 

,6?23 

-9,2671 

, 0575 

19,2 

46.66 

1 . 1 9 ? 3 

13,68 

,0250 

-6,0666 

, 0604 

19.4 

45,37 

1,2706 

12,01 

,o?80 

-7 ,06  00 

, 0630 

19.6 

4 4.04 

1,3502 

10.60 

,6310 

*6,2075 

,0671 

19.6 

42.37 

1,4302 

9,41 

,6344 

-5,4924 

, 0708 

20.G 

41.64 

1.5108 

8,41 

,6381 

-4,8874 

,0/49 

20 .? 

40,9? 

3 .5930 

7,5  3 

.Ml’ 

•4,3582 

, 0793 

ii  0 . 4 

40  ,c° 

1.6756 

6,77 

,6461 

.3,9048' 

,0841" 

20.6 

39.35 

1,7599 

6,11 

,6504 

-3,5073 

,0095 

20.8 

38,69 

1,6150 

5,54 

,6551 

-3,160’ 

, 095  3 

21.0 

38, C9 

1.9314 

5,03 

,6601 

•2,6550 

,1018 

21.2 

37,54 

2.0193 

4,57 

,6654 

• 2 , 5e  2’ 

,1090 

21.4 

37,0? 

2,1066 

4,1? 

,6710 

•2 , 34 i9 

,1171 

21.6 

36.60 

2,1995 

3,61 

,6769 

-2,1256 

,1262  ' 

21.8 

36.20 

2 . 2 9 ? 2 

3,40 

,6032 

-1,9312 

,1365 

22.0 

35.63 

2,3861 

3,19 

,6900 

•1,7595 

, 148  3. 

22.2 

35.49 

2 . 4 4 2 8 

2,93 

,6970 

- 1 , 6 0 0 6 

,1617 

22.4 

35,19 

2.58H 

2,69 

, '046 

-1,4509 

,1773 

22,6 

34,91 

2,6*13 

2,47 

,7127 

-1,3314 

,1955 

22.8 

34.65 

2.7840 

2,27 

,7213 

-1,2155 

,21/2 

*—✓ 

23.0 

34,4? 

2,8897 

2.09 

,'304 

•1,1062 

,2437 

23.2 

34,21 

2,9974 

1,93 

, 7403 

-1,0127 

,2758 

23.4 

34.02 

3,1065 

1,78 

1,64 

,7H07 

*,’246 

,3166 

• 

23.6 

33,64 

3,2230 

,7610 

-,8434 

,3699 

23.8 

33,68 

3.  HO” 

1,51 

, 7 737 

-,7697 

,4416 

24.0 

33,53 

3,44?5 

1,39 

, 7064 

-.7023  ~ 

,5442 

24,2 

33,40 

3,5*82 

1,28 

, 8001 

-,6408 

, 7024 

24.4 

33,27 

3,7185 

1,10 

,0148 

- -,5843 

,9799 

24.6 

33,16 

3,6542 

1,09 

,0305 

-,5321 

1,6002 

24.8 

33,  C6 

3,9947 

1,00 

,04/5 

-,4854 

4,1086 

142 
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RATIO 

TOTAL 

FRROR 

STF-P 

VAR 

FRPOR 

9 A« 
STI-.P 

ccvap 

17,0 

209.40 

,1767 

646,73 

,5948 

"384,1749 

' 

4 17.2 

1 5 4 , 5 5 

, 2475 

329,44 

,5952 

"195,5955 

17.4 

124 , 1 r> 

.3185 

196,68 

, 5 '» 5 8 

•117,9960 

17.6 

104.06 

• 3 n 9 5 

13?,84 

,5966 

■ 7ft,  7595 

17. n 

91.59 

, 460b 

94,84 

,50/6 

■56,1789 

10. c 

«1.87 

,‘324 

70,90 

,59b6 

■4l,99l9 

10.2 

74  , 47 

.6042 

55,02 

,5998 

■ 32 , 503J 

18.4 

66.67 

.6764 

43,84 

,8012 

•25,8566 

18. ft 

64,00 

,7483 

35,70 

,6027 

"21,0245 

18.  B 

6o.l8 

.621  7 

29,60 

,6044 

"17,3952 

19,0 

56,99 

.5950 

24,90 

,6063 

"3  4 ,6()45 

19.2 

54,30 

,9687 

21,21 

,6065 

" 1 2 , 4 J 47 

19.4 

‘->2,0  0 

1 « 0 4 ? 9 

18,25 

, 6l 0 7 

-10,6584 

19.6 

5G  .C2 

1.1178 

15,65 

,01  31 

■9,2291 

19.8 

46, ?9 

1.3934 

13,66 

, 6 1 5 7 

•6,0493 

20.0 

46,76 

1.2696 

12,21 

,6164 

• 7 ,0671 

20.2 

45,45 

1 . 3 4 6 5 

10,82 

,6?l5 

•6,2432 

2Q.4 

44,27 

1.4242 

9,64 

,6?46 

-5,5400 

20.6 

43.23 

1.5027 

6,63 

1 6 2 ft  1 

• 4 , 9 4 06 

20.9 

. 42.30 

l,58l6 

7,76 

,8320 

-4,4279 

21,0 

41,45 

1.6624 

6,99 

-,8357 

•3,9710  .. 

21.2 

40.70 

1.7435 

6,33 

,6399 

• 3 , 5 6 (1 0 

21.4 

4 Cl  . C? 

1 .i3?60 

5,74 

, 6443 

-3,2332 

21.6 

39,41 

1.9395 

5,23 

,6490 

•2,9280 

21.9 

33.65 

1,9947 

4,76 

,6539 

•2,6536 

22.0 

36,34 

2 , C " 0 9 

4,35 

.6591 

•2,4112 

22.? 

37,68 

2.1666 

3,98 

,6847 

•2,1940_ 

22.4 

37,46 

2 . 2 r>  7 7 

3,65 

.8706 

•1,9993 

V* 

22.6 

37.0-3 

2.3485 

3,35 

,6768 

•1,8242 

22.8 

36.7  3 

2,4410 

3,03 

,6835 

•1,6658 

23.0 

36,41 

2.5356 

2,84 

,6905 

•1,5214 

23.2 

36.12 

2.6Ti6 

2,61 

,6960 

• 1 1 39 i5 

I? 

23,4 

35.85 

2,7302 

2.41 

, 7060 

•1,2733 

23.6 

35.61 

2,8314 

2,22 

,7143 

•1,1641 

23.9 

35,39 

2.9343 

2.09 

,7?34 

•1,0667 

r 

24  . C 

35.18 

3 ,0406 

1,89 

. 7329 

",9751 

24,2 

35,00 

3,1496 

1.75 

, 7430 

-,8922 

■ ' 

24.4 

34.6? 

3.2614 

1.62 

,7539 

* ,0168 

24.6 

34,67 

3,3766 

1.49  .. 

, 7656 

",74/7 

fl 

24  .ft 

34,53 

3,4961 

1,38 

. 7778 

6829 

25. C 

34.40 

3.6188 

1,27 

,7912 

",6251 

25.? 

34.27 

3.7466 

111* 

, 8 053 

" , 57  07 

I! 

25.4 

34, 17 

3.0784 

1,09 

,8206 

",5220 

1- 

25,6 

34.07 

4,0157 

1,00 

,8369 

-, 47ft6 

I' 

r 


MTF 


,0323 

,0335 

,U34H 
, 0362 
, 0377 
, 2 
, 0 4 0 w 
,0«  26 
, 0445 
,0*65 
,0*86 
, 0509 
, 053  3 
, 0 •>  5 V 
,0506 
,0016 
,0649 
,0604 
,0721 
, 0762 
..  ,pay7 
, 0«56 
,0910 
,OV09 
,1035 
,1107 

,1200 

,1304 

,1501 

,1637 

,1  793 

,19/6 
,2156 
,2437 
,270a 
, Jl«3 
,<1717 
, 4425 
,544b 
,6V9o 
,9707 
1,546a 
3,7054 
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f 


N s 3r> 


RATIO 

total 

FrPPOR 

sur 

VAR 

FRUOR 

VAR 

STfcp 

CQVAR 

HTTP 

17.2 

527.15 

,0666 

435i,99 

,5858* 

2549,0763 

, 0296 

17.4 

272.33 

.1373 

1087,36 

,5861 

-636,7760 

, 0307 

, 17.6 

107,49 

.2000 

482,73 

,586b 

•202,6285 

,931“ 

17.8 

1 4 5 . 1 4 

, 2749 

271,03 

,5869 

-150,5634 

,0330 

18.0 

119.79 

,3438 

173,07 

,5875 

*■101,1764 

,0343 

18.2 

l')2  <" 

.4129 

119,90 

,5883 

-70,0382 

, 0356 

18.4 

90.98 

.4422 

87,83 

,5892 

-51,2560 

,03/0 

w — 

18.6 

82.  C3 

.5516 

57, on 

,5903 

-39,0505 

, 0305 

3.8.  G 

75.11 

• 6?1 6 

52,73 

,>915 

-30 ,69^7 

.04Q1 

,0*18 

19.0 

69,59 

, 69 1 8 

42,51 

,5929 

-24,7051 

19.2 

65.1? 

,7623 

34,95 

,5944 

-20,2799 

, 0436 

19.4 

6 1 , 4 1 

,6332 

29,20 

,5960 

-16,9062 

, 0454 

19.6 

58.30 

. 9 C 4 4 

24,73 

,5978 

-14, ?9o3 

, 0475 

19.0 

55,66 

,9761 

21, 19 

,5993 

-12,2179 

,0*96 

20.0 

53,36 

1,0464 

18,32 

,9019 

-10,5362 

,0»19 

20.2 

51.42 

l.lSll 

15,98 

, 6fi43 

•9,1691 

, 054  J 

w 

20.4 

49,70 

1 , 1 0 4 5 

14,04 

,6060 

•0,0323 

, 056V 

20,6 

48,20 

1,248? 

12,42 

,6096 

■ 7 ,0866 

, 059  7 

20.« 

46,06 

1,3428 

11,04 

,6125 

-6,2619 

, 0626 

) 

2l.fi 

45,68 

1,4103 

9,06 

,6155 

•5,5912 

, 0660 

21.2 

44,62 

1,4946 

6,05 

,6107 

•4,9976 

. 0696 

21.4 

43.67 

1.5717 

7,97 

,6221 

•4,4*42 

,0734 

21,6 

42.82 

1,6492 

7,21 

,6760 

•4,0433 

, 0775 

21.8 

42.05 

1.72fa3 

6,54 

,6298 

•3,6465 

,0^21 

22.0 

41.36 

1.P063 

5,94 

,6339 

-3,3014 

, 0670 

w 

22.2 

40,73 

1,0891 

5,42 

,6304 

•2,9968 

,0V24 

22.4 

40.15 

1,9713 

4.95 

4,54 

,6430 

-2,7239 

,0904 

22,6 

39,64 

2,0543 

,6481 

-2,4836 

,1050 

- 

22.8 

39.16 

2,1389 

4,16 

,6533 

•2,2654 

,1123 

23.0 

36,73 

2,2254 

3, a? 

,6587 

•2,0666 

,1205 

23.2 

38.33 

2,3126 

3,52 

,6647 

-1,8914 

,1297 

23.4 

37.97 

2,4019 

3,24 

,6708 

•1,7296 

,1401 

23,6 

37,64 

2,4932 

2,99 

,6772 

-1,5626 

,1520 

23.6 

37,34 

2.5857 

2,76 

,6042 

•1,4510 

,1656 

24,0 

37.06 

2.6805 

2,54 

,69i6 

•1,3296 

,1813 

24.2 

36,  Bi 

2,7767 

2,35 

,6995 

-1,2216 

, 1 V95 

24.4 

36,57 

2.8759 

2,18 

, 7077 

-1,1197 

,2215 

24,6 

36,36 

2,9771 

2,01 

,'166 

-1,0279 

,2476 

24,8 

36,16 

3,0*313 

1,86 

,7259 

-,9423 

.2000 

25.0 

35,96 

3,J<84 

1,72 

,7357 

-,8635 

,320V 

25.2 

35,81 

3,2979 

1.60 

, 7464 

-,7927 

,3730 

25.4 

35 , 66 

3,4113 

1,48 

,/375 

•,7260 

, 4441 

25,6 

35,5? 

3.57/6 

1.37 

,7696 

- , 6661 

,5433 

25.8 

35,39 

3,6401 

1,27 

,/825 

-.6102 

, 6 V55 

26.0 

35,28 

3,7727 

1.17 

, 7962 

-,5589 

,9563 

26.2 

35,17 

3,9620 

1,09 

,8109 

-.5115 

1,5090 

-> 

26.4 

35,07 

4.0359 

1,00 

,0267 

-,46d4 

3,4366 

144 


N s 36 


RATIO 

TOTAL 

error 

*T£P 

SIZE 

VAR 

ERROR 

VA« 

STEP 

coy  a* 

MTTf 

10.0 

233.74 

,1669 

746,38 

,5780 

•430 , 9003 

, 0303 

18.2 

172.22 

,2337 

300,25 

,3784 

•219,4196 

• ,0314 

10.4 

130,12 

,3007 

229,60 

,5789 

•132,4085 

,0326 

10.  A 

116,40 

,3476 

153,37 

,5795 

• 08 , 38 1 7 

' ,0336 

10.0 

101.56 

. 4350 

109,55 

,5804 

•63,0030 

,0351 

19.0 

90,64 

,5025 

82,00 

,5813 

•47 , 1604 

, 0364 

19.2 

02.34 

,570(? 

63,63 

,5823 

•36,5555 

, 037« 

19.4 

75.01 

,6302 

50,71 

,503b 

•29,0917 

,0394 

19.6 

70 ,5ft 

,7064 

41,33 

,5848 

•23,6762 

,0440 

19.9 

66,26 

. 7749 

34,29 

,5864 

•19,6115 

, 0427 

20.0 

62.66 

,64  30 

?6,d6 

,■5080 

•16,4704 

,0444 

20.2 

59,6? 

,9132 

24,59 

,5997 

•14,0123 

, 0464 

20.4 

57.0? 

,90.31 

?1,17 

,5916 

•12,0364 

, 0404 

20.  A 

54,70 

l,Or’33 

10,4  0 

,5937 

•10,4369 

, 0906 

20,0 

52.03 

1.1241 

16,12 

,5959 

•9,1187 

, 052? 

21.0 

31.11 

1,1955 

14,21 

,5983 

•0,0156 

, 0953 

21.? 

49.61 

1,2472 

12,61 

,6010 

•7,0975 

,0960 

21.4 

40.27 

1.3400 

11,24 

,9Q36 

• 6 ,3036 

, OftQ0 

21.6 

47.00 

1,4129 

10,00 

,6066 

• 5 ,6363 

,0039 

21.0 

. <6,01 

1,4072 

9,07 

,h096 

•5,0491 

,0072 

22.0 

45.05 

1.5619 

8,19  . 

,<>130 

•4,5441 

, 0700 

22.2 

44,19 

1,6373 

7,42 

,916b 

•4,1045 

,0/46 

22.4 

43.41 

1,7137 

6,75 

,6?0i 

•3,7166 

,0/68 

22.6 

42.7c 

1.7911 

6,1b 

,6?43 

■3,3731 

,0*33 

22.8 

42.05 

1,0698 

5,62 

,0283 

•3,0651 

,O«03 

23.0 

41.47 

1.9492 

5,14 

,6328 

■2,7936 

,0938 

23.2 

40,94 

2 , 5296 

4,72 

,6375 

•2 | 55 16 

1 099  8 

23,4 

40,45 

2, 1115 

4,34 

,9424 

•2,3323 

,1064 

23.6 

40,00 

2,1950 

3,99 

,6475 

•2, 13?9 

,1139 

23.0 

39,59 

2,2796 

3,68 

,6530 

•1,9540 

,1221 

24.0 

39.2? 

2,3455 

3,40 

,6508 

• 1 , 79 ?6 

,1313 

24.2 

36,60 

2.4529 

3,14 

,6650 

•1,6406 

,1417 

24.4 

30,56 

2,5424 

2,90 

,6714 

•1.5106 

,1537 

24.6 

38,27 

2,6335 

2,68 

,6762 

•1,3877 

, i6  73 

24.0 

36.00 

2,7767 

2,48 

,6854 

•1,2748 

,1031 

25.0 

37,76 

2, 6213 

2,30 

,6932 

•1,1733 

,2014 

25.2 

37,53 

2,9186 

2,14 

,7013 

*1,0766 

,2232 

25.4 

37,33 

3,0160 

1,98 

,7099 

*,9920 

, 2495 
,2610 
,3220 

25,6 

37,14 

3,1?0« 

1,04 

,7190 

• , 91 13 

25. C 

36,96 

3.2250 

1,70""' 

,7287 

■,8382 

20.0 

36.00 

3,3327 

1,50 

,7390 

-,7702 

,3741 

26.2 

36,05 

3,4430 

1.47 

,7499 

- , 7072 

,4442 

26.4 

30.52 

3,5500 

1,34 

,7616 

*,6495 

,5426 

26.6 

36,39 

3,6760 

1,26 

, 7740 

•,5962 

,6V17 

26,8 

36,20 

3,7978 

1,17 

, 7874 

*,5473 

,9436 

27.0 

30.17 

3,9230 

1,00 

,0016 

•,5026 

1,4909 

27.2 

36, 0« 

4,0500 

1,00 

6168 

• , 46  08 

3,1616 
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ratio 

total 

LHROI’ 

SUn 

sue 

VAR 

KRHOR 

VAR 

STfcP 

cqvaR 

18.2 

568,13 

.0^49 

5000*07 

1249,57 

,5697-* 

2046,6846 

18.4 

3j3. 32 

. 1 ? 9 9 

,5699 

•711,6779 

ie.6 

2i.ifa.47 

.1949 

554 ,70 

,57C2 

•315,7976 

18.6 

1®1.14 

,2899 

311,64 

.5707 

•3.77,3514 

i°.o 

1*2.80 

,3251 

199,04 

.5712 

•113,1988 

.19.2 

113.95 

,?9C5 

137,89 

.5719 

•76,3571 

19.4 

1U0.55 

.4860 

101,05 

,5727 

•57,3752 

19.6 

90.52 

.5217 

77,10 

,5736 

•43,7232 

19,6 

*2.77 

.5876 

6o  ,70 

,5746 

•34,3842 

20.0 

76,60 

,6537 

48,98 

,5759 

•27,7092 

20,2 

71.57 

.720?. 

40,30 

,9772 

•22,7636 

20.4 

67,41 

,7871 

33,68 

,5766 

•10,9931 

20 .6 

63.9i 

.8542 

28,54 

,5001 

•16,0651 

20.6 

80,94 

,9?l7 

24,47 

,5019 

•13,7450 

21.0 

58,39 

,9897 

21, 1* 

,5837 

•11,0710 

21. 2 

56.17 

l.c'Jfic 

18,49 

,9858 

•10,3428 

21,4 

54.23 

1.1270 

16,25 

,5078 

•9,0666 

2l,6 

52,53 

1,1.961 

14,39 

,5903 

•0 . 01 04 

21.8 

51.C2 

1,2061 

12,81 

,5928 

•7 ,1102 

22,0 

49.68 

1. 3366 

11,46 

,5953 

•6,3377 

22.2 

46,48 

1,4081 

10.29 

,5981 

•5,6749 

22.4 

47.40 

1.4799 

9,29 

,6011 

•5,1039 

22.6 

46.44 

1,5823 

8,41 

.6043 

•4,6075 

22.8 

45,56 

1,6?57 

7,64 

,6077 

•4,1693 

23.0 

44,76 

1,700? 

6,96 

,6111 

•3,7798 

23.2 

44,04 

1.7755 

6,35 

.6148 

•3,4360 

23.4 

43,36 

1,8515 

5,81 

,6188 

•3,1327 

23,6 

42.78 

1,9287 

5,33 

,6229 

•2,8588 

23,  G 

42,24 

2.C068 

4,90 

,6273 

•2,6150 

24.0 

41,74 

2,0862 

4,51 

,6319 

•2,3946 

24.2 

41.28 

2,1663 

4,16 

,6369 

•2,1961 

24.4 

4Q.86 

2.2460 

3,H4 

,6421 

•2,0189 

24.6 

40.47 

2, 3^13 

3,55 

,6475 

•1,8541 

24.0 

40,11 

2,4161 

3,29 

,6532 

•1,7041 

25,0 

39,79 

2.5019 

3,05 

,6593 

■1,5696 

25.2 

39,49 

2,5899 

2,«2 

,6656 

.1,443« 

25,4 

39,21 

2.6790 

2,62 

,6725 

•1,3312 

25.6 

38,95 

2,7706 

2,43 

,6795 

•1,2249 

25.0 

38,7? 

2,0641 

2,26 

,6870 

•1,1209 

26,0 

36,50 

2,9596 

2, in 

,6950 

•1,0403 

26.2 

38,30 

3,2571 

1,95 

,7035 

-.9593 

26.4 

36,12 

3, 1576 
3,200-’ 

1,81 

,7123 

•,0831 

26,6 

37,95 

1,60 

,7218 

•,8132 

26.8 

37,79 

3,3659 

1,56 

,7319 

•,7495 

27.0 

37.65 

3,4748 

1,45 

, 7425 

• , 6699 

27.2 

37,5? 

3.5867 

1,35 

, 7539 

-.6348 

27  .4 

37,39 

3,7022 

1 ,26 

,7660 

•,5839 

27,6 

37,28 

3,£2l4 

1,17 

,7789 

•,5372 

27.0 

37, 18 

3,9448 

1.00 

, 7927 

-.4941 

28.0 

37.  C8 

4.CU« 

1,01 

,0074 

".4540 

h t r f 


, 0279 
,0289 

_ , U 29 V 
,0310 
,03^1 
, 0333 
,0345 
,03te 
, 0372 
,0386 
,Q«C2 
,0«lb 
, 0445 
,0453 
, 0472 
, 0493 
,0515 
, 053  5 
,0563 
,0590 
,l>619 
, 0650 
, Ot'O  3 
,0719 
,0/5« 
, 0500 
, 0646 
,0696 
, 0951 
,1012 
,107V 
, 1153 
,1236 
,1329 
,1433 
,1553 
,1088 
,1848 
,2032 

',2250 

,2510 

,2«33 

,3236 

,3748 

,4440 

,5403 

,6854 

,9270 

1,4120 

2,0993 
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ratio 

total 

STH' 

VAR 

VAM 

CQVAR 

MJT1 

error 

S1ZF: 

ERROR 

STEP 

19.0 

259.41 

,1581 

854,73 

,5625 

•480,3135 

,0286 

19.2 

190,83 

,2214 

435,41 

,562ft 

•244,5556 

,0296 

19.4 

152.83 

,2848 

263,00 

,5633 

•147,6421 

,0306 

19.6 

126.70 

.3483 

175,76 

,5639 

<.98,6137 

,0317 

19. ft 

112.04 

.4120 

125,53 

,5646 

*7 0,3724 

,0326 

20.0 

99,87 

, *758 

9-4,03 

,5654 

<*52,6608 

, 0340 

20.2 

90.59 

,5399 

72,94 

,5662 

*40,8057 

,0352 

20. A 

83.31 

.6041 

58,19 

,5673 

*32,5164 

,0360 

20.6 

77.43 

,6686 

47,43 

,5684 

*26,4659 

,9379 

20. « 

72.62 

, 7333 

39,37 

,5698 

■21,940b 

, 0394 

21.0 

68,59 

,7935 

33,18 

,5712 

*13,4448 

,0409 

21.2 

65. 19 

,3539 

28,27 

,5727 

*15,6997 

,0*26 

21.4 

62,27 

,9297 

24,37 

,5744 

*13,5035 

, 0443 

21. ft 

59,76 

.9958 

21, 19 

,5762 

-11,7224 

,0461 

21. B 

57,57 

1,0623 

18,58 

,5782 

*10,2564 

,0481 

22.0 

55,64 

1,1296 

16,39 

,5802 

*9,0243 

,0902 

22.2 

53.94 

1,1971 

14,56 

,5824 

*7,9945 

,0924 

22.4 

52,43 

1.2654 

12,99 

,5847 

*7,1141 

,0948 

22,6 

51.0’ 

1,3340 

11,66 

,5873 

•6,3642 

,09/3 

22.8 

49, 8P 

1.4C33 

10,50 

,5899 

•5,7163 

,0600 

23,0 

48,79 

1,4732 

9,50 

,5928 

•5,1527  _ 

_ , 0629  

23.2 

47.81 

1,3440 

8,62 

,5957 

*4,6565 

,066  0 

23.4 

46,93 

1,61.50 

7,85 

,5991 

•4,2287 

, 069  J 

23.6 

46,12 

1,6874 

7,16 

,5023 

•3,8421 

,0/30 

23, ft 

45.39 

1,7603 

6,55 

,6059 

■3,5021 

, 0769 

24,0 

44.72 

1.8341 

6,01 

,6097 

•3,1994 

,0911 

24.2 

44,11 

1,9089 

5,52 

.9136 

•2,9266 

,0658 

24.4 

43.55 

1,9848 

5,09 

,0178 

•2,6611 

,0909  - 

24,6 

43,03 

2,0618 

4,69 

,6221 

*2,4394 

, 0964 

24.6 

42,56 

2,1394 

4,33 

,6268 

•2,2622 

,1025 

25.0 

42.13 

2,2188 

4,01 

,9316 

■2,0790 

,1092 

25.2 

41.73 

2. 2992 

3,71 

,6367 

•1.9J41 

,1167 

25.4 

41.36 

2 , 3 8 0 8 

3,44 

,9421 

•1,7643 

,1250 

25.6 

41,02 

2,4640 

3,19 

,947« 

•1,6268 

,1343 

25,8 

40.71 

2,3492 

2,96 

,9536 

*1,4984 

,1449 

26,0 

40.42 

2,6354 

2,75 

,6600 

*1,3631 

,196V 

26.2 

40.15 

2,7231 

2,56 

,6667 

•1,2779 

,1704 

26,4 

39,9! 

2,8130 

2,38 

,0737 

•1,1796 

,1862 

26,6 

39,68 

2,9049 

2,21 

- *68li 

■1,0689 

..,2p47  _ 

26.6 

39,47 

2,9986 

2,08 

,9889 

•1,0098 

,2264 

27,0 

39,28 

3.0947 

1,92 

,9972 

-,9284 

,2926 

27.2 

39.10 

3,1928 

1,79 

,7060 

-,8578 

,2143 

27.4 

38,94 

3,2941 

1,66 

,7151 

4,7910 

,3244 

27,6 

33,73 

J , 3976 

1,55 

, 7250 

*,7303 

,3752 

27,0 

38,64 

3,8044 

1,44 

,7353 

•,6732 

.4434 

28.0 

38.51 

3,6141 

1,34 

,7464 

•i62QB 

,9380 

28,2 

38,40 

3,7272 

1,25 

,7582 

•,5725 

,6/89 

28,4 

38,29 

3,6441 

1,16 

,7707 

*,5273 

,vuv 

28,6 

38.10 

3,9645 

1,0« 

,7340 

•,4859 

1,3679 

28.5 

38.09 

4,0902 

1,01 

, 7981 

• ,4469 

2,7029 

29.0 

38.01 

4,2198 

,94 

i 8134 

. -,4118 
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RAT 

total 

K H R 0 R 

STEP 

SIZE 

VAR 

ERROR 

VA« 

STEP 

CQVA* 

mttf- 

1’.2 

652,53 

, * 6 1 6 

57q6,73 

, 5550* 

3166,5355 

,0265 

19.4 

335.98 

,1232 

l4?5,5o 

,5551 

*79(j  ,7590 

,0273 

19,6 

23u,59 

.1443 

0 3 3 1 0 3 

,5554 

•35l,06l6 

,0282 

19. 

177.97 

.2466 

355,56 

,5557 

•197,0890 

, 0292 

20.0 

146,47 

,3084 

227,22 

,5562 

•125,8853 

, 0302 

20.? 

125,52 

,3703 

157,48 

,3568 

•87,1936 

,0312 

20.4 

110.59 

,4324 

115,38 

,5575 

.6 3 , 8 246 

, 0323 

20.6 

99  45 

,4946 

88,12 

69,36 

,5584 

•48,7040 

, 0334 

20. « 

90;ao 

,5571 

,5592 

*36,2874 

,0346 

21.0 

83.93 

,6196 

55,98 

,?602 

*30,8676 

, 0359 

21.2 

78.33 

.6*27 

46,05 

,5614 

*29,3721 

, 0372 

21.4 

73.69 

,7458 

38,55 

,5627 

*21,1962 

,0386 

21.6 

69,79 

,8093 

32 , 08 

,5640 

*17,9391 

, 0 A 0 1 

21.8 

66,46 

,8732 

28,03 

,5659 

*15,3560 

,0417 

22.0 

63,61 

,9373 

24,28 

,?671 

•13,2758 

, 0434 

22.2 

61,13 

1,0017 

21,21 

,5689 

,5708 

,5727 

*11,5789 

, 0451 

22.4 

58,96 

1,0567 

18,67 

• 10 , 1661 

, 0470 

22,6 

57,05 

1,1321 

16,51 

• 8, 98£)7 

, 0489 

22.8 

55 , 35 

1,1980 

14,7? 

,5748 

•7,9789 

,0510 

23.0 

53,35 

1,2642 

13,19 

,57/2 

.7,1297 

, 0533 

23.2 

' 52,50 

1.3312 

11,86 

,5796 

•6,3929 

,0557 

23.4 

51,29 

1,3965 

10,72 

,5822 

•5,7604 

,0532 

23.6 

50.19 

1,4666 

9,71 

,5650 

*5,2045 

,060V 

23.8 

49,20 

1,5353 

6,83 

,5878 

-4,7174 

, 0638 

24.0 

46,30 

1,6051 

8,05 

,5907 

•4,2826 

, 0670 

24.2 

47,48 

1,6752 

7,37 

,5940 

•3,9033 

,0704 

24.4 

46,73 

1,7462 

6,75 

,5973 

*3,5631 

, 0740 

24,6 

46,05 

1,8179 

6,20 

,6009 

•3,2611 

, 0780 

24.8 

45,43 

1,8905 

5,71 

,6047 

*2,9898 

,0623 

25.0 

44,66 

1,9639 

5,27 

,6087 

•2,7461 

, 0669 

25.2 

44,33 

2,0387 

4,87 

,6127 

•2,5230 

,0920 

25.4 

43.84 

2,1145 

4,50 

,6171 

•2,3212 

,0V76 

25,6 

43,40 

2.1909 

4,17 

,6218 

•2,1411 

,1037 

25,8 

42.99 

2,2491 

3,87 

,6265 

•1,9725  . 

,1105 

26,0 

42.61 

2,3479 

3,59 

,6317 

•1,8229 

,1180 

26,2 

42.26 

2,4286 

3,34 

,6369 

■1,6623 

,1264 

26.4 

41,93 

2,5105 

3,10 

,6429 

.1,5545 

,1357 

26,6 

41,64 

2,9939 

2,89 

,6464 

•1,4365 

,1463 

26.8 

41,36 

2,6788 

2,69 

,6546 

.1,3286 

,1583 

27.0 

41,10 

2,7654 

2,50 

,6611 

*1 1 2290  " 

' ,1719 

27,2 

40.87 

2,8533 

2,34 

,6681 

•1,1385 

,1676 

27.4 

<0.65 

2,9435 

2,18 

,6754 

•1,0533 

,2059 

27.6 

40.44 

3,036? 

2,03 

,6829 

*,9730 

,2279 

27.8 

40,26 

3,1302 

1,89 

,6911 

*,9012 

,2537 

28, 0 

40,08 

3,2272 

1.77 

,6996 

*,6328 

,2656 

28,2 

39,92 

3,3263 

I.*9 

,7087 

•,7702 

,3251 

2«.4 

39.78 

3.4279 

1.54 

,7183 

*,7123 

,3754 

28,6 

39,64 

3, 53?5 

1,43 

,7284 

*,6563 

,4421 

28,8 

39,51 

3,6404 

1,34 

, 7391 

*,6075 

,5355 

29,0 

39,40 

3,79l3 

1.25 

,7505 

*,5611 

,6726 

29.? 

39,29 

3,6657 

1.1* 

, 7 627 

•,5180 

,8963 
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N * 39 


RATIO 

total 

LRROU 

STfP 

SIZE 

VAR 

ERKOR 

VAR 

STEP 

C0VAH 

MITF 

29,4 

39,19 

3,9640 

1.08 

,7756 

-.4781 

1,3264 

29.6 

39.10 

4,1063 

1.01 

,7  693 

-.4411 

2.4V53 

29.6 

39,01 

4,2334 

.’4 

,8039 

*,4Q65 

18 ,9u20 

' 


Column  1 is  the  ratio  £(i-l)Xj/£Xj 

Column  2 is  the  estimate  for  the  total  ^rror  content 


Column  3 is  the  normeil  estimate  for  step  size:  in  order  to  determine  the 
actual  estimate  for  the  step  size,  the  entry  in  this  column  should  be  divided 
by  the  total  observation  time  T. 


Column  1*  is  the  approximate  standard  deviation  of  the  estimate  of  the  total 
error  content. 

Column  5 is  the  normed  standard  deviation  of  the  estimate  of  the  step  size: 
in  order  to  obtain  the  actual  standard  deviation  the  entry  in  this  column 
should  be  divided  by  the  total  time  T. 

Column  6 is  the  normed  covariance  between  II  and  ♦:  in  order  to  obtain  the 

actual  estimated  covariance  the  entry  should  be  divided  by  T. 

Column  T is  the  normed  IfTTF  and  in  order  to  obtain  the  actual  value  the 
entry  should  be  multiplied  by  T. 
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N ■ 40 


RATIO 

TOTAL 

ERROR 

STEP 

SIZE 

VAR 

ERROR 

VAR 

STEP 

C0VAO 

PTTP 

20.0 

206,39 

• 1502 

971,58 

,5482 

-532,1015 

,0270 

20.2 

210,41 

.2103 

,2705 

495,19 

,5485 

•271.1069 

, 027V 

20.4 

108,27 

2’9,i4 

,5489 

•163,6966 

.,020* 

20.6 

l4l,5l 

,3300 

199,89 

,3494 

•109.3232 

,0290 

20.0 

123,04 

.3912 

142,01 

,3500 

■78,0470 

,0300 

,0318 

21,0 

109,52 

,45i9 

106,96 

,3507 

• 56 , 4 0 06 

21.2 

99,25 

.5125 

83,0’ 

,3510 

■45,3322 

, 0329 

21.4 

91.15 

,5735 

66,27 

,5524 

■36,1149 

,044; 

21.0 

04,62 

,0347 

54,04 

,5534 

■29,4127 

, 0333 

21.0 

79,27 

,6960 

44,89 

,3540 

■24,3996 

,0466 

22.0 

74,79 

,7577 

37,81 

,3558 

■20,5197 

,0479 

22.2 

71,00 

,8197 

32,26 

,!»571 

■17,4793 

,0394 

22.4 

67,76 

,80i9 

27,82 

,3586 

•15,0490 

, 0409 

22.6 

64,96 

,9444 

24,22 

,3002 

•13,0761 

,0424 

22,0 

62,50 

1.0074 

21.23 

,>6l« 

■11,4410 

,044; 

23,0 

60.36 

l,07o3 

18.76 

,3037 

•10,0042 

, 0499 

23.2 

50,46 

1.1344 

16,68 

,3057 

■8,9470 

, 0477 

23.4 

56,77 

1,1986 

14,90 

,3077 

•7,9744 

,0497 

23.6 

55,26 

1,2633 

13,37 

,3098 

•7,1363 

,0319 

23,0 

53,91 

1,3284 

12,07 

,3723 

■6,4236 

, 0341 

24,0 

' 52,69 

1,3942 

10,92 

,5747 

.5,7974 

,0365 

24.2 

51,59 

1,4600 

1,5278 

9,92 

,3773 

.3,2497 

, 0391 

24,4 

50,50 

9,03 

,3799 

•4,7634 

,0419 

24.6 

49,67 

1,5954 

0,26 

,3029 

■4,3394 

, 0648 

24,0 

48,84 

1,6637 

7,57 

,3859 

•3,9610 

,0600 

25.0 

48,09 

1,7325 

6,95 

,3892 

■3,6270 

,0714 

25,2 

47,39 

1.0026 

6,39 

(39?5 

•3 , 32l5 

.,0*91 

25.4 

46,76 

1,8731 

5,90 

,3901 

•3,0510 

, 0790 

25.6 

46,17 

1,9446 

5,45 

,3990 

■2,8060 

,0034 

25.0 

45,63 

2,0109 

5,04 

,0038 

■2,5652 

,0080 

26.0 

45,13 

2,0905 

4,67 

,6079 

■2,3024 

,0*32 

26.2 

44,60 

2.1051 

4,33 

.0122 

•2,1982 

,0988 

26,4 

44,20 

2,2402 

4,03 

,016’ 

■2.Q329 

.,1049 

26.6 

43.86 

2,3169 

3,74 

,6217 

■1,8798 

,1117 

26,0 

43.50 

2.3947 

3,40 

,6207 

•1,7394 

,1192 

27,0 

43,17 

2,4743 

3,24 

,6319 

■1,6086 

,1270 

27,2 

42,00 

2,5545 

3,02 

,0375 

■1 ,49 13 

,1469 

27,4 

42.57 

2.6366 

2,82 

,6433 

•1,3809 

,1479 

27,6 

42.30 

2,7204 

2,63 

,6493 

■1,2787 

,1390 

27.0 

42,00 

2,8054 

2.43 

,0550 

■1,1159 

,1732 

20.0 

41,83 

2.0926 

2,29 

,6023 

•1,0985 

,1091 

20.2 

41,62 

2,90O9 

2.X4 

,6698 

■1,0193 

,2p74 

2S.4 

41.42 

3,07l7 

2,00 

,6773 

•,9446 

,2289 

20.6 

41.24 

3,1040 

1,87 

,6851 

•,8743 

,2350 

20.0 

41,07 

3,2395 

1,79 

,0936 

_ •,®1U  .. 

,2062 

29.0 

40,92 

3,3570 

1,63 

,7024 

•,7512 

,3254 

29.2 

40.77 

3,4571 

1,53 

,7117 

■ ,6931 

,3753 

29,4 

40,64 

3,5590 

1,43 

,7210 

•,6439 

,44Q9 

29,6 

40.51 

3,6653 

1,33 

,7321 

•,5930 

,3315 

29.0 

40,40 

3,7743 

1.24 

,7431 

■ ,5506 

,6098 

4 0.0 

40.29 

3,8664 

1,16 

,7549 

• ,5Q93 

,9001 

ISO 


RATIO 

TOTAL 

ERROR 

STEP 

SIZE 

VAR 

ERROR 

VAR  ... 
STEP 

,CQ  VAR.. 

PTT? 

30.2 

40,19 

4,0024 

1,08 

,7674 

• » 47q5 

1 1 2873 

30.4 

40,10 

4,1221 

1,01 

,7807 

• ,4348 

2,3380 

30.6 

40,02 

4,2462 

,94 

,7949 

•|4P16 

It i $924 

Column  1 Is  the  ratio  £(i-l)Xi/rxi 

Column  2 is  the  estimate  for  the  total  irror  content 

Column  3 1*  the  noraed  estimate  for  step  size:  in  order  to  determine  the 
actual  estimate  for  the  step  size,  the  entry  in  this  column  should  be  divided 
by  the  total  observation  time  T. 

Column  U is  the  approximate  standard  deviation  of  the  estimate  of  the  total 
error  content. 

Column  5 is  the  normed  standard  deviation  of  the  estimate  of  the  step  size: 
in  order  to  obtain  the  actual  standard  deviation  the  entry  in  this  column 
should  be  divided  by  the  total  time  T. 

Column  6 is  the  norraed  covariance  between  U and  4:  in  order  to  obtain  the 

actual  estimated  covariance  the  entry  should  be  divided  by  T. 


Column  7 is  the  normed  MTTF  and  in  order  to  obtain  the  actual  value  the 
entry  should  be  multiplied  by  T. 


N « 41 


HAT  JO 

total. 

ERROR 

STEP 

SIZE 

VAR 

ERROR 

var 

STEP 

CQVAR 

MTU 

20.2 

720. I6 

,0586 

6467,08 

.5412. 

• 3499 

,6596 

, 0251 

2q  • A 

37fl  ,30 

,1172 

1*15,53 

,54i3 

-674 

,0199 

,0259 

20. * 

253,83 

.1758 

717,65 

,>410 

■ 388 

,1920. 

,02*7 

20. A 

199,64 

.2345 

403,13 

,>4i9 

•217 

,9623 

, 0276 

21.0 

1*0,81 

,2933 

257,64 

,>424 

-139 

,2361 

,0289 

2l,2 

137,62 

.3522 

178,54 

,5428 

-96 

,4231 

,0294 

21,4 

121,11 

,4112  • 

130,64 

,5434 

-7q 

,6041 

,0304 

2l  ,6 

106,78 

,4703 

99,94 

,5442 

.93 

,8881 

,0314 

21, 8 

99.21 

,5296 

78,73 

,5450 

.42 

,4077 

,0324 

22.0' 

91,59 

,5891 

63,56 

,5459 

.34 

• 2000 

,0339 

22.2 

85.39 

,6469 

52,33 

,5469 

-28 

,1240 

,0347 

22.4 

80.24 

,7088 

43,79 

,5480 

-23 

,5030 

,O30Q 

22.6 

75,92 

,7690 

37,16 

,5492 

• 1* 

,9147 

,0372 

22.8 

72.24 

,8294 

31,90 

,5500 

•17 

, 0670 

, 0386 

23.0 

69,06 

,6901 

27,65 

,5520 

-14 

,7666 

,0400 

23.2 

66.30 

,95j3 

24,10 

,5535 

•12 

,8790 

,0416 

23,4 

63,69 

1 i 01?7 

2l»28 

,5552 

■ 11 

,3219 

,0431 

23.6 

61,76 

1,0746 

18,85 

,5509 

■ 10 

,0109 

,044b 

23.6 

59,86 

1.1369 

16,80 

,5587 

-8 

,900® 

,0406 

24.0 

56,18 

1,1995 

15,06 

,>007 

-7 

,9593 

,0485 

24.2 

56,67 

1.2627 

13,55 

• >028 

-7 

.1441 

,0505  . ... 

24,4 

55,32 

1,3260 

12,26 

,5651 

*6 

,4463 

,0527 

24,6 

54,09 

1 , 39  o4 
1,4551 

11 1 12 

,5674 

-5 

,-8271 

,0950 

24.8 

52, 9B 

10.12 

,5699 

• 5 

i 2683 

,0574 

25.0 

51,97 

1,5205 

9,24 

,5729 

• 4 

,8120 

,0600 

25.2 

5l,04 

1,5864 

8,46 

,5752 

-4 

,3903 

, 0028 

25.4 

50,20 

1,6530 

7,76 

,5781 

r 4 

,0152.  ... 

,0657 

25.6 

49,44 

1,7197 

7,15 

,>814 

-3 

,6853 

,0689  - 

25,8 

48,74 

1,7877 

6,59 

,5840 

-3 

,3846 

,0723 

26,0 

46,06 

1,8565 

6,08 

,5879 

-3 

,1120 

,0700 

26.2 

47,49 

1,9259 

5,63 

,>9l6 

-2 

,8662 

,0800 

26,4 

46,94 

1,9963 

5,22 

,5953 

• 2 

,6460 

,0«44 

26,6 

46,43 

2,0470 

4,84 

,5991 

• 2 

,4421  

,0b91 

26,8 

45,96 

2,1402 

4,49 

,*032 

• 2 

,2572 

,QV43 

27,0 

45.52 

2,2136 

4,18 

,*075 

• 2 

,0680 

,099V 

27,2 

45,12 

2,2878 

3,89 

,*121 

-1 

,9349 

,1061 

27,4 

44,75 

2,3630 

3,63 

,*109 

■ 1 

,7947 

,1126 

27.6 

44.41 

2,4396 

3,39 

,*219 

• 1 

,6642 

,1204 

27,8 

44,09 

2,5176 

3,16 

,*271 

-1 

,5440 

,1287 

28.0 

43.79 

2,5974 

2,95 

,*329 

• 1 

,4309 

,1362 

28,2 

43,51 

2.6780 

2,76 

,6382 

-1 

,3287 

,1488 

28.4 

43,25 

2,7601 

2,58 

,6443 

-1 

,2343 

,1607 

28.6 

43,01 

2,5444 

2.41 

,6509 

■ 1 

,1445 

,1745 

28.8 

42,79 

2,9298 

2,25 

,*572 

• 1 

,0631 

, 1VQ2 

29,0 

42,59 

3,0171 

2,11 

,6642 

II 

,9870 

,2086 

29.2 

42.40 

3,10*3 

1,97 

,*716 

• 

,9105 

,2301 

29.4 

42,22 

3,1972 

1,85 

,6795 

,8910 

,2956  - 

29.6 

42, C6 

3,2909 

1,73 

,*87* 

% 

,7090 

,2«7i 

29.8 

41. 9l 

3,3064 

1,02 

, 6963 

* 

,7333 

,3255 

40.0 

41,77 

3,4849 

1,51 

,7053 

m 

,6796 

,3750 

40.2 

41,63 

3,5857 

1,42 

,7150 

n 

,6302 

,4396 
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RATIO 

total 

ERROR 

STfcP 

SIZE 

VAP 

ERROR 

VAR 

STEP 

co var 

MTTF. . _ 

30.4 

41.  Si 

3,6894 

1,33 

,7252 

•,5841 

,5284 

30.6 

41.40 

3.7959 

1,24 

, 736  0 

-,5415 

, 6569 

30.8 

41.30 

3,9060 

111* 

, 7474 

. ,5013 

,6633 

31.0 

41.20 

4.01®8 

1,08 

,/599 

• , 46  37 

'1,2465 

31.2 

41.11 

4,1369 

1,01 

, 7724 

",  4294 

2,1830 

31.4 

41.03 

4,2583 

,95 

, 7861 

",3972 

8,3415 

Column  1 is  the  ratio  E( i— X ) X ^ /EX^ 

Column  2 is  the  estimate  for  the  total  irror  content 

Column  3 is  the  normed  estimate  for  step  size:  in  order  to  determine  the 
actual  estimate  for  the  step  size,  the  entry  in  this  column  should  be  divided 
by  the  total  observation  time  T. 

Column  U is  the  approximate  standard  deviation  of  the  estimate  of  the  total 
error  content. 

Column  5 is  the  normed  standard  deviation  of  the  estimate  of  the  step  sise: 
in  order  to  obtain  the  actual  standard  deviation  the  entry  in  this  column 
should  be  divided  by  the  total  time  T. 

Column  6 is  the  normed  covariance  between  II  and  + : in  order  to  obtain  the 

actual  estimated  covariance  the  entry  should  be  divided  by  T. 

Column  T is  the  normed  MTTF  and  in  order  to  obtain  the  actual  value  the 
entry  should  be  multiplied  by  T. 
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RAT  jn 

TOTAL 

ERROR 

STfcP 

SIZE 

VAR 

ERROR 

VA» 

STEP 

CQVAR 

MTU 

21,0 

314,73 

.1430 

1096,00 

,9350 

•586,6743 

,0256 

21.2 

260.94 

. 2002 

559,64 

,5352 

•299,0231 

,0264 

21, A 

l84,46 

.2576 

330,10 

,5356 

•1«Q|572Q 

...,f<73 

21.6 

154,95 

.3150 

226,01 

,5360 

•120,6495 

, 0201 

21.3 

134,54 

,3725 

161,43 

,5363 

•06,1067 

, 0290 

22.0 

119,63 

.4302 

120,96 

,>371 

•64,4732 

, 029V 

22,2 

108.27 

,4880 

93,93 

,5378 

• 50 ,0213 

,0309 

22.4 

99,34 

,5458 

75,01 

,5387 

•39,9092 

,0319 

22,6 

92.14 

,604G 

61,19 

,5396 

•32,5191 

,093Q 

22.3 

86.21 

.6624 

50,02 

,5406 

•26,9732 

, 0341 

23,0 

81.26 

. 7?09 

42,83 

,5416 

•22,7054 

, 0353 

23.2 

77,06 

,7798 

36,56 

,5428 

•19,3532 

, 0366 

23.4 

73.47 

,8389 

,3981 

31,55 

,5441 

•16,6771 

,03/9 

23.6 

70,37 

27,48 

,5456 

•14,4999 

, 0393 

23.3 

67,65 

65.26 

,9570 

24,U 

,5470 

•12,6967 

, 0407 

24.0 

1 • C 1 79 

21,30 

,5485 

•11,1972 

, 0422 

24.2 

63.15 

1,0783 

18,94 

,5502 

*9,9347 

,0438 

24.4 

61,27 

1,1391 

16,94 

,>520 

•8,8650 

, 0456 

24.6 

59,60 

1,2000 

15,23 

,3541 

•7,9552 

,U4?3 

24.8 

. 58.09 

1,2619 

13,74 

,5960 

•7,1530 

, 0493 

25.0 

56.73 

1.  J23'7 

12,43 

,5583 

• 6 , 47  07 

,0513 

25.2 

55,50 

1,3862 

11,33 

,5606 

•5,8685 

,0334 

25.4 

54,37 

1,4497 

10,32 

,3628 

•5,3292 

,0358 

25.6 

53.36 

1,5132 

9,44 

,5654 

• 4 , 0 6 .']  2 

,0582 

25,8 

52,42 

1,5776 

8,66 

,5680 

•4,4438 

,0600 

26.0 

51,57 

1,6424 

7,96 

, 5708 

•4,0720 

, 0636 

26.2 

5Q,80 

1,7076 

7,34 

,5738 

•3,7420 

, 0666 

26,4 

50,08 

1.7739 

6,79 

,5769 

•3,4421 

, 0698 

26.6 

49,42 

1,8408 

6,27 

,5801 

•3,1708 

, 0 733 

26.8 

48,81 

l,9Cbo 

5,61 

,5835 

•2,9250 

, 0770 

27.0 

48.24 

1,9772 

5,39 

,5870 

*2,7013 

, 0810 

27.2 

47,72 

2,0464 

5,01 

,5907 

*2,5002 

, 0054 

27,4 

47,24 

2,1167 

4,66 

,5946 

•2,3145 

,0901 

27,6 

46,60 

2,1879 

4,34 

,5907 

*2,1449 

,0953 

27.8 

46.39 

2,2596 

4,05 

,6031 

•1,9916 

,1009 

28,0 

46,00 

2,3331 

2.4C79 

3,79 

,6075 

•1,8400 

,1071 

28.2 

45.64 

3,52 

,6121 

*1,7144 

,1140 

28,4 

45.31 

2,4831 

3,30 

,6172 

*1,5946 

,1213 

28,6 

45. Cl 

2,5599 

3.08 

2.88 

,6223 

•l,4e22 

,1299 

28,8 

44.72 

2,6382 

.6277 

•1,3773  ' 

,1394 

29.0 

44,45 

2,7179 

2,70 

,6333 

•1,2803 

,1500 

29,2 

44,21 

2,7967 

2,53 

,6393 

,6455 

•1,1915 

,1619 

29,4 

43.98 

2.8814 

2,37 

•1,1078 

,1756 

29,6 

43.76 

2,9656 

2,22 

,6520 

•1,0302 

,1»13 

29.8 

43.57 

3,0*12 

2,09 

,6590 

*,9591 

,2094 

60.0 

43.39 

3,1389 

1,95 

,6663 

",  8923 

,2308 

60.? 

43.21 

3. 2289 

1,63 

,o730 

",8290 

,2565 

60.4 

43,05 

3,3206 

1.71 

,0*1* 

",7712 

,2872 

60.6 

42.93 

3,4147 

1,61 

,0903 

• ,7166 

,3255 

60.8 

42.76 

3.5113 

1|S>1 

,6992 

*,6655 

,3741 

61.0 

42,63 

3,6104 

1,41 

, 7006 

",6100 

,4374 
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PAT  I P 

TOTAL 

ERROR 

STEP 

size 

VAR 

ERROR 

VAR 

STEP 

_ COVAR 

MTTF. 

31.? 

42.51 

3,7122 

1.32 

,7186 

-,5736 

,*241 

31.4 

42.40 

3,6169 

1,24 

,7291 

-,5324 

,6189 

31.6 

<2.30 

3,9248 

111* 

,7402 

-,4938 

,4)459 

31.8 

<2.21 

4,0362 

1,09 

,7519 

-,4576 

1,2043 

32,0 

42.12 

4.1-513 

i.02 

, 7644 

-,4239 

2,0540 

32.2 

<2,04 

4,2702 

.95 

,7776 

-,3927 

6,5840 

Coluam  1 is  the  ratio  E( i-lJXj/fXj 

Column  2 is  the  estimate  for  the  total  ^rror  content 

Column  3 is  the  normed  estimate  for  step  sire:  in  order  to  determine  the 
actual  estimate  for  the  step  sire,  the  entry  in  this  column  should  be  divided 
by  the  total  observation  time  7. 

Column  It  is  the  approximate  standard  deviation  of  the  estimate  of  the  total 
error  content. 

Column  5 is  the  normed  standard  deviation  of  the  estimate  of  the  step  sire: 
in  order  to  obtain  the  actual  standard  deviation  the  entry  in  this  column 
should  be  divided  by  the  total  time  T. 

Column  6 is  the  normed  covariance  between  It  and  +:  in  order  to  obtain  the 

actual  estimated  covariance  the  entry  should  be  divided  by  T. 

Column  7 is  the  normed  IfTTF  and  in  order  to  obtain  the  actual  value  the 
entry  should  be  multiplied  by  T. 
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N 

s 43 

PATIO 

total 

CL 

*▲. 

%- 

in 

VAP 

V A« 

covap 

MTU' 

- 

f:  K 9 G N 

s i z i: 

r-KHOH 

3TfcP 

21.2 

79i , l 7 

« 0 n 5 8 

7285,25 

, 3?B3- 

3349,5027 

, 0239 

21.4 

4 ii  ft  , 3 4 

, 2. 1 1 7 

lrt20,6; 

,5?86 

.O6l,de08 

,0246 

21. A 

278,14 

.1676 

8nft ,31 

,5?88 

-42 6 , 9 Qb5 

,0254 

2l.H 

214.14 

,2236 

454,24 

,5291 

-239,8280 

, 0261 

22.0 

1^5.79 

.2796 

2^0,25 

,5294 

*153,1667 

,0269 

22.2 

l^O  . 3c 

,3357 

201,2* 

, 5 ? 9 9 

•106,1767 

,0773 

'22.4 

132.12 

,3*19 

147,56 

, 5305 

*77,7742 

,0286 

22.6 

116,53 

,446? 

112,73 

,5311 

*59,3744 

, 0293 

22.0 

11.7,99 

.5047 

88,8? 

,531« 

*46 ,7362 

, 0303 

23.0 

[^.fco 

, 56 1 4 

71,74 

,5326 

• 37 , 7 1 1 1> 

,0315 

23.2 

'>2.76 

,618? 

59,08 

,5335 

•3l,02lV 

, 0325 

23.4 

07,0* 

,6752 

49,47 

,5345 

*25,9491 

, U 3 3 6 

23.6 

02,30 

» 7 3 ? 5 

4i,97 

,5355 

*21,9775 

, U 3 4 / 

23  . B 

78.24 

,7899 

36,05 

,5367 

*13,8537 

, 0359 

24 . 0 

74,7? 

,3478 

31.24 

,5379 

•16.3Q96 

, 0372 

24.2 

71 , 66 

• 9 q5  7 

27,33 

,5393 

•1 4 ,24  52 

,0385 

24.4 

69.00 

,9642 

?4 ,07 

,540? 

•■12*5227 

, 0399 

24.6 

66,65 

1.0??7 

21,36 

,5423 

*11,0520 

,0414 

24. fl 

64,55 

1.0"l« 

19,04 

,5439 

*9,8675 

, 0*29 

' 

25.0 

62.69 

1.1*05 

17,0* 

,54b# 

-8,8393 

, 0443 

25.2 

6l,Cl 

1.2000 

15,39 

,5475 

*7 ,94q6 

, 046  2 

25.4 

59.50 

1.26H 

13,92 

,5495 

*7,1630 

,0*81 

25.6 

56.13 

1 , 321 7 

12,64 

,5515 

• 6 ,4867 

, 0300 

25.6 

56,89 

1 , 3 8 ? 9 

11,51 

,5537 

*5,8928 

, 0320 

26.0 

55.77 

1,4444 

10,52 

,5560 

-5,3724 

, 0342 

26.2 

54.74 

1,5065 

9,64 

,5584 

14,9077 

,0363 

26.4 

53,61 

1,5689 

8,87 

,5611 

-4,4997 

, 0390 

26,6 

52,95 

1,6321 

8,17 

,5638 

•4,l3l3 

,0616 

' 

26,8 

52.16 

3 ,6961 

7,53 

,5665 

*3,7971 

,034  4 

27.0 

51,4? 

1,7607 

6,97 

,5694 

*3,4979 

, 0674 

27.2 

50,75 

1 , 6 ? 5 9 

6,45 

,5725 

-3,2280 

, 0707 

V 

27.4 

50.13 

1 , 6*1 7 

5,99 

,5758 

*2,9340 

, 0741 

27.6 

49,55 

1,9587 

5,56 

,3791 

-2,7567 

, 07  79 

27,8 

49,02 

2,0261 

5,17 

,5827 

*2,5564 

,061V 

_y 

28.0 

4S.53 

2.0*45 

4,82 

,5864 

*2,3700 

, 0663 

28.2 

48,07 

2,1637 

4,50 

,5902 

**2 , 1999 

,0911 

28.4 

47,65 

2,2240 

4,20 

,5943 

*2,0429 

, 0963 

- 

28.6 

47.25 

2,3051 

3,92 

,5985 

el , 8992 

,1020 

28.8 

46,69 

2 , 3774 

3,67 

,6030 

*1,7659 

,1082 

29.0 

46,55 

2, 4507 

3,43 

, 6R76 

-1,6431  ‘ 

,1151 

29,2 

46,23 

2,5248 

3,21 

, *126 

*1,5311 

,1226 

29,4 

45,94 

2,6003 

3,01 

,*177 

•1,4269 

,1309 

29,6 

45,66 

2,6777 

2,82 

,6229 

*1,3273 

,1403 

29.8 

45,40 

2,7559 

2,65 

,6286 

*1,2368 

, 131  U 

30,0 

45,17 

2,6354 

2,48 

,6345 

'•1,1532 

,1629 

30,2 

44,94 

2.9171 

2,33 

,0405 

*1,0733 

,1766 

* 

30.4 

44,73 

2.9997 

2,19 

,6471 

*1,0008 

,1922 

30,6 

44,54 

3.CP45 

2,05 

,6538 

*,93l7 

,2104 

30.8 

44,36 

3 , 1 7 06 

1,93 

,6610 

* , 8687 

,2313 

* 

31.0 

44,19 

3,2190 

1,61 

,6684 

-,8067 

,2370 

31.2 

44. C4 

3,3494 

ll  70 

,6762 

*,7**8 

,2876 
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RATIO 

total 

error 

ST  fc;P 
size 

9 AR 
ERROR 

VAR 

STEP 

oqvaR. 

h.TTK 

3i , 4 

43.69 

3.44*9 

, 6845 

”,7 007 

,3254 

3l  .6 

43,76 

3.4J7u 

1 1 so 

.6932 

-,65lS 

,3/34 
, 4 J5V 

3l.8 

43,63 

3,6343 

1,40 

,-'023 

■ , 6 057 

32.0 

43.52 

3,7342 

1,32 

,7121 

* , 5635 

,5i«9 

32,2 

43.41 

3,b372 

1.24 

,7?23 

*,5235 

,6417 

42.4 

43.31 

3.9431 

1,16 

,7331 

-,4862 

,«312 

32.6 

43,21 

4,1)523 

1,09 

7445 

* , 49 13 

1,1600 

32.8 

43.12 

4,1646 

1,02 

, 7566 

*,4191 

l',V26Q 

33,0 

43,04 

4,2412 

,7694 

",388V 

5,3134 

Column  1 Is  the  ratio  l(l-l)Xj/EX, 

Column  2 is  the  estimate  for  the  total  ^rror  content 

Column  3 is  the  normed  estimate  for  step  size:  in  order  to  determine  the 
actual  estimate  for  the  step  size,  the  entry  in  this  column  should  be  divided 
by  the  total  observation  time  T. 

'Column  It  is  the  approximate  standard  deviation  of  the  estimate  of  the  total 
error  content. 

Column  5 la  the  normed  standard  deviation  of  the  estimate  of  the  step  size: 

In  order  to  obtain  the  actual  standard  deviation  the  entry  In  this  column 
should  be  divided  by  the  total  time  T. 

Column  6 is  the  normed  covariance  between  II  and  4:  in  order  to  obtain  the 

actual  estimated  covariance  the  entry  should  be  divided  by  T. 

Column  7 Is  the  normed  HTTP  and  in  order  to  obtain  the  actual  value  the 
entry  should  be  multiplied  by  T. 
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RATIO 

TUTaL 

F;RKOR 

3T[;P 

SIZL 

VaR 

PRROR 

v,\R 

STbP 

CQVAH 

r-TTF 

22.0 

344.42 

.1365 

1 233 , 5 0 

,5226 

-644 

, 3347 

, 0244 

22.2 

2^2.4? 

• I’ll 

623,86 

,5229 

-328 

,3043 

,0251 

22.4 

201,38 

, 2456 

379,94 

,?232 

- 1 9 8 

, 2683 

,0258 

22.4 

168,96 

, 3 0 0 6 

253,94 

,?235 

-132 

,4463 

, 0266 

22.  B 

1.46 , 5*' 

,3556 

1 8 1. 1 * 1 

,‘•>240 

-9  4 

,6182 

, 0274 

23.0 

1*0. 21 

,41  04 

136,05 

,?246 

- 7 0 

,89i6 

, 0283 

23.2 

1 1 7 . 7 o 

,4456 

105,64 

,5252 

-54 

,9/95 

,0291 

23.4 

1u7.88 

, 5 .?  0 3 

84,36 

,5259 

-43 

,8679 

, 030  1 

23.6 

99,96 

,576? 

68,85 

,??67 

- 3 5 

, 7674 

,0310 

23. S 

93.44 

.6318 

57,20 

,5276 

s29 

,6603 

, 0320 

24  . o 

87.99 

, 6 n 7 6 

45,24 

,5266 

-25 

, 0043  • 

, 0331 

24.? 

&3.3« 

, 7436 

41. 19 

,5?96 

-?1 

.3234 

, 0342 

24.4 

79.41 

.7998 

35,55 

.5307 

-Id 

, 3723 

, 0353 

24.6 

75.98 

,8563 

30, 97 

,5320 

-15 

,9813 

, 0365 

24.8 

73.00 

,9l?9 

?7,2l 

,5334 

■sl4 

,0192 

, 0378 

25.0 

7 0 . 34 

. 9 7 c 1 

?4,04 

,5347 

il2 

,3648 

, 0391 

25.2 

66.0? 

.1 . C 9 7 4 

? 1 , 3 9 

,5362 

-10 

,9821 

,0«05 

25.4 

65. R5 

1 • 0 A 5 C 

19,15 

, 5 3 7 H 

-9 

,8095 

, 0420 

25.6 

64.09 

1.14  31 

17,22 

,5395 

-6 

,8015 

, 0435 

25 , B 

62.4? 

1,2016 

15,54 

,5412 

-7 

,9262 

,0452 

26.0 

6 y , 9 1 

1 « 2 6 0 3 

14,10 

,5432 

*7 

f 17JV 

, 0469 

26.2 

59.55 

1.3194 

12,83 

,5452 

- 6 

,5142 

,0487 

26.4 

56.30 

1.379? 

11  , 7 1 

,54/3 

-5 

,9285 

,0507 

26.4 

*7.18 

1.4391 

10.73 

,5496 

-5 

,4177 

, 0527 

26.6 

56.13 

1 ,5l0u 

9,64 

, 55 1 b 

-4 

,9545 

, 0549 

27.0 

55.19 

1 ,56c9 

9,06 

,5543 

-4 

,5492 

,05/3 

27.2 

54,3? 

1,6  225 

6,38 

,5570 

,5595 

-4 

,1844 

,0597 

27.4 

53.51 

1,625? 

7,72 

- 3 

,8503 

,0624 

27.6 

52.77 

1.746? 

7,13 

,5623 

• 3 

.5519 

,0652 

27.8 

52.09 

1 ,8 11 7 

6,63 

,5653 

-3 

,2834 

,0683 

28.0 

5l , 46 

1.5757 

6,17 

,5685 

- 3 

,0413 

,0/15 

28.2 

50.67 

1.94Q7 

5,74 

,5717 

-2 

,8182 

,0/50 

2e  ,4 

50,33 

2,0064 

5,35 

,5751 

-2 

t6l46 

,0/8/ 

28,6 

49,82 

2.0730 

4,99 

,5786 

-2 

,4273 

,0826 

23.8 

49,36 

2,1403 

4,66 

,5823 

-2 

,2566 

,0S?2 

29.0 

48.92 

2,2035 

4,35 

,5062 

92 

,0993 

,QV2U 

29.2 

45.51 

2,2761 

4 , 07 

,*901 

-1 

,9520 

, 0972 

29.4 

48.14 

2,3461 

3,81 

,5943 

il 

,8188 

,102V 

29. ft 

47.79 

2,4l9u 

3,57 

,5968 

.6034 

-1 

,6962 

,16*1 

29.8 

47,46 

2 , 49 1 3 

3,35 

-1 

,5813- 

,1166 

30.0 

47.16' 

2.564C 

3,14 

,6082 

• 1 

,4742 

,1236 

30.2 

46.87 

2,6393 

2,95 

2,77 

.6132 

-1 

,3753 

,1320 

30.4 

46.60 

2,7154 

,6184 

-1 

,2822 

,1414 

30.6 

46,34 

2, */927 

2,00 

,9239 

■»1 

.1961 

,1520 

3o  .8 

46,12 

2 , *3  7 1 3 

2,44 

,6297 

• 1 

,1163 

,1640 

31,0 

45.91 

2.9512 

2,29 

,9358 

■*1 

,0423 

, i 7 7 5 

31.2 

45.71 

3, 0325 

2.16 

,9422 

,9.733 

,1929 

31,4 

45.52 

3,1158 

2,03 

,6489 

,9081 

,2110 

31.6 

45.35 

3,2311 

1,91 

,65;>8 

,8467 

,2322 

3l.8 

45.18 

3.2884 

1,79 

,6630 

,7886 

,2574 

32.0 

45.03 

3.  J77? 

1,68 

i 67q7 

,7355 

,28/9 
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RATIO 

total 

ERROR 

STEP 
S ! li 

V*R 

ERROR 

VAR 

STEP 

cqvar 

_ HTTP... 

<12.2 

44.89 

3 , 46fi0 

1 itifi 

,6789 

*,6862 

,3249 

<12.4 

44,75 

3,5614 

1.49 

,6874 

*,6390 

,3/21 

<12.6 

44,63 

3,6572 

1.40 

,6963 

«,59*9 

,4333 

32.fi 

44,52 

3,7555 

1,31 

, 7 057 

-,5539 

,5157 

33.0 

44  41 

3,8564 

1,23 

,'157 

-.5155 

,6332 

33,2 

44,31 

3,9603 

1,16 

, '262 

-,4799 

,6141 

33.4 

44,22 

4,0675 

1,09 

,7373 

* , 4457 

1,1302 

1,6189 

4,5069 

33.6 

44.13 

4,177V 

1,02  . 

, '490 

- , 4143 

33.fi 

44,  C* 

4,2920 

,96 

,'614 

-,5849 

Column  1 Is  the  ratio  E(i-l)X1/EXi 

Column  2 is  the  estimate  for  the  total  irro r content 

Column  3 la  the  normed  estimate  for  step  size:  in  order  to  determine  the 
actual  estimate  for  the  step  size,  the  entry  In  this  column  should  be  divided 
by  the  total  observation  time  T. 

Column  It  Is  the  approximate  standard  deviation  of  the  estimate  of  the  total 
error  content. 

Colusa)  5 Is  the  normed  standard  deviation  of  the  estimate  of  the  step  size: 

In  order  to  obtain  the  actual  standard  deviation  the  entry  in  this  column 
should  be  divided  by  the  total  time  T. 

Column  6 is  the  normed  covariance  betveen  II  and  4:  in  order  to  obtain  the 

actual  estimated  covariance  the  entry  should  be  divided  by  T. 

Column  7 Is  the  normed  I4TTF  and  In  order  to  obtain  the  actual  value  the 
entry  should  be  multiplied  by  T. 
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RATIO 

total 

F RRGR 

SUP 

MZF 

VAR 

FRHOR 

waH 

bTfcF 

cgvA« 

HTTP 

22.? 

865.50 

.0534 

0162 » 65 

,5166- 

4216,0646 

,0220 

22.4 

AA'i  , 9? 

,10*7 

?039 , 6? 

,5167- 

1 fj  33 ,3010 

,0235 

22.  A 

ou3 , 6q 

, 1 6 G 1 

905,95 

,5169 

•467,7507 

2?.  3 

233.46 

.2136 

506 , 96 

,U71 

•262,6788 

, 0240 

23.0 

lr'1.46 

,2671 

325,34 

.=>174 

• 167  , d 4 1 8 

,0256 

23.? 

1*3,51 

,3fV 

. 3744 

2?6 , 58 

,5i78 

-116,3160 

,0263 

23.4 

143.60 

165,47 

,’104 

•05,2799 

,02/1 

23.6 

12B.70 

126,43 

.>190 

•65,1146 

, 027V 

23.3 

117,15 

,4821 

99,64 

,5i96 

-51,2748 

,0280 

24.0 

107,94 

.5361 

80 ,49 

.•>203 

• 41 , J8o5 

, 0296 

24.2 

100.42 

, 5°  0 4 

66,30 

,>?10 

•34,0481 

,0306 

24.4 

94.19 

,0448 

55,53 

,>2l9 

•20,4833 

,0315 

24.6 

38.95 

,6993 

47,15 

,??29 

-24,1622 

,0325 

24. a 

84.47 

.754? 

40,43 

,3239 

-20,7136 

,0336 

25.0 

*0.61 

,80*2 

35,12 

,5250 

-17,9424 

, 0347 

25.2 

77.2  6 

,0044 

30,73 

, 5?62 

-15,6792 

, 0359 

25.4 

74.32 

,9399 

27,08 

,>275 

-13,7956 

, 0371 

25.6 

71,72 

, 9756 

24,04 

,5?89 

-12,2255 

, 0384 

25,8 

69.42 

1.0317 

21,46 

,='304 

-10,8523 

,0397 

26.0 

67.35 

1.0082 

19,25 

,2319 

-9,74V? 

,04U 

26.2 

65.51 

1.M49 

17,36 

,2336 

-0,7740 

-,Q426 

26,4 

63.34 

1.2020 

15,71 

,5353 

-7,9227 

, 0442 

26  ,6 

62,33 

1.2594 

14,28 

,23;  1 

-7  ,ie5« 

,0450 

26.6 

6Q.96 

1.3174 

13,02 

,2391) 

-6,5332 

, 0476 

27.0 

59.71 

1.3759 

11.90 

,2410 

-5,9563 

, 0494 

27,2 

58,57 

1,4343 

10,92 

,>433 

-5,4556 

,0514 

27.4 

57,53 

1.4935 

1 0 i 0 5 

,5455 

-5,0035 

,0534 

27.6 

56,56 

1.5537 

9,25 

, 5477 

-4,5921 

, 0557 

27.8 

55,68 

1,6138 

8,55 

,2502 

-4,2311 

,0580 

28.0 

54,87 

1,6748 

7,91 

,2527 

-3,9015 

, 0605 

28.? 

54.12 

1,7360 

7,34 

,255b 

• 3 ,6q60 

,0632 

2b. 4 

53,4? 

1,7983 

6,81 

,5583 

•3,3369 

,0660 

28,6 

52,78 

1.8610 

6,34 

,5612 

-3,0927 

.0991 

26.8 

52.19 

1,9241 

5,91 

,5644 

-2,87l9 

, 0723 

29.0 

51.63 

1.9882 

5,51 

,5676 

-2,6671 

, 0758 

29.2 

51,12 

2,053? 

5,14 

,2709 

•2,4789 

,0796 

29,4 

50,64 

2,1188 

4,81 

,2744 

-2,3077 

,0037 

29,6 

50,19 

2,1051 

4,50 

,2781 

-2,1500 

,0881 

29,8 

49,78 

2,2520 

4,22 

«2 | 00o2 

, 0 V 2V 

30.0 

49,39 

2,3206 

3,95 

,5860 

-1,0695 

,0981 

30.2 

49.03 

2,3899 

3,71 

,2901 

-1,7437 

,1030 

30.4 

48,69 

2,4098 

3,48 

,2946 

-1,6291 

,1100 

30.6 

48,38 

2,5300 

3,27 

,2992 

-1,5226 

,1169 

30.8 

48,08 

2 , 6C35 

3,07 

,6039 

-1,4208 

,1245 

31,0 

47,81 

2. 6770 

2,89 

,6008 

-1,3276 

,132V 

31.2 

47,55 

2,7520 

2,71 

,9140 

-1,2398 

,1424 

31,4 

47.31 

2,8277 

2,56 

,*195 

-1,1*00 

,1528 

31.6 

47,09 

2,9061 

2,40 

,o?52 

-1,0644 

,1647 

31.8 

46.86 

2,9841 

2,26 

,9311 

-1,0131 

,1782 

32,0 

46,68 

3,0646 

?,13 

,6374 

-,9463 

,193b 

3? , 2 

46,50 

3, 1466 

2,00 

,0439 

- ,8843 

,2117 

100 


N 

a 45 

PATIO 

TOTAL 

*>T{  P 

vak 

VA« 

CQVA* 

MTTF 

ERROR 

SI2F 

ERROR 

STEP 

32.  A 

46.33 

3.2303 

1,89 

,6508 

-,8264 

, 2326 

32.6 

46.17 

o • 3 'L  6 Q 

1,78 

,0579 

',7715 

,2576 

32. « 

46,02 

3.4038 

1,67 

,6654 

',7J95 

,287V 

33.0 

45,86 

3. 4?33 

1,57 

, 673  J 

-,67l7 

,3247 

33,2 

45,75 

3,5451 

1,48 

,6616 

- , 6266 

,3710 

33.  A 

45.63 

3.6794 

1,39 

,6903 

•,5841 

,4312 

33,6 

45.52 

3.7759 

1,31 

,6996 

-,5446 

,5115 

33,« 

45,41 

3 , 0 7 4 8 

1,23 

,7093 

•,5079 

,0243 

34,0 

45.31 

3,9772 

1,18 

.7195 

-.4726 

, 7V95 

34.2 

45.22 

4,0821 

1,09 

, 7303 

•,4404 

1,0944 

34.4 

45.14 

4 , 1 9 0 5 

1,02 

,7417 

•,4097 

1,7205 

34,6 

45.06 

4,3022 

,96 

, 7537 

-,3ei3 

3,8910 

1/ 

\ 

I 


Column  1 Is  the  ratio  I(i-l)X1/EX1 

Column  2 is  the  estimate  for  the  total  irror  content 

Column  3 is  the  normed  estimate  for  step  sizes  in  order  to  determine  the 
actual  estimate  for  the  step  size,  the  entry  in  this  column  should  be  divided 
by  the  total  observation  time  T. 

Column  It  is  the  approximate  standard  deviation  of  the  estimate  of  the  total 
error  content. 

Column  5 is  the  normed  standard  deviation  of  the  estimate  of  the  step  sizes 
in  order  to  obtain  the  actual  standard  deviation  the  entry  in  this  column 
should  be  divided  by  the  total  time  T. 

Column  6 is  the  normed  covariance  betveen  IJ  and  ♦ : in  order  to  obtain  the 

actual  estisnated  covariance  the  entry  should  be  divided  by  T. 

Column  T is  the  normed  MTTP  and  in  order  to  obtain  the  actual  value  the 
entry  should  be  multiplied  by  T. 
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N * 46 


RATIO 

total 

FtPRO^ 

SU  p 
SI7L 

V AH 
r'RKOR 

VaR 

51EP 

CQVAR 

23.0 

375.39 

. 1 305 

1370,70 

.5111 

-704,1230 

23.? 

274.85 

.1020 

702,98 

,5113 

-356,9503 

23.4 

219. C5 

,?35l 

424,73 

, 5 ) 1 6 

• 216 ,7855 

23,6 

lfl3.01 

.2875 

203,95 

.5119 

•144,6660 

23. 0 

1^9.1? 

,7399 

203,01 

,51.24 

•103,52oe 

24.0 

141,20 

, 3 9 2 5 

152,17 

.5129 

-77,5431 

24,? 

127.54 

, 4451 

118,24 

,5135 

-60,2136 

24.4 

110.79 

,497  V 

94,41 

,5141 

-40,0373 

24  , ft 

H'0. 11 

,550« 

77,g7 

, 5j  48 

-39,1790 

24.6 

100.97 

,6039 

64 ,05 
54,02 

.5156 

-32,5234 

25.0 

94,99 

,6572 

.5164 

-27,4004 

25.2 

89,93 

, 7 1 C 7 

46,14 

,5173 

-23,3751 

25.4 

85.59 

,764? 

39,86 

.5184 

*20,1673 

25. ft 

01.03 

.5101 

34,73 

,5J95 

-17,5503 

25. P 

76.54 

,8722 

30,51 

,52Q6 

-15.39Q3 

26.0 

75,64 

, 9 ? 6 6 

26,98 

,5210 

-13,5089 

26.2 

73,  CP 

,9012 

24,02 

21,51 

,5232 

-12,0796 

26,4 

70,  BC 

1,0360 

,5247 

-10,7966 

26 . 6 

68.76 

1 ,C*11 

19,36 

,5262 

-9,6905 

26.0 

66.92 

1,1467 

17,49 

,527  8 

' -0,7457 

• 27,(j 

65.24 

1.2C2S 

15,06 

,5?93 

-7 ,9066 

27.? 

63.74 

1,2589 

1,3155 

14,44 

,5312 

* 7 f 1002 

27,<t 

62,37 

13,20 

,5331 

-6,5535 

27.6 

61,11 

1,37?7 

12,09 

,5349 

-5,9058 

27.0 

59.97 

1,430.1 

1.1,11 

,5370 

-5,4861 

28.0 

50.92 

1,4877 

10,24 

,5393 

.5,0454 

28.2 

57,94 

1,5466 

9,44 

,5414 

-4,6370 

28.4 

57.06 

1,6052 

8,74 

,5438 

-4,2799 

28,6 

5o.24 

1,6645 

8,11 

,5464 

-3,9569 

28,8 

55,47 

1.7248 

7,32 

,5409 

-3,6500 

29,o 

54,77 

1.7851 

7,0  0 

,5516 

-3,3924 

29.2 

54,12 

1 ,b46i 

6,52 

,5545 

-3,1500 

29.4 

53, 5g 

1,9 003 

ft . 00 

,5573 

-2,9236 

29.6 

52.94 

1,970-6 

5,68 

,5605 

-2,7214 

29.8 

52.42 

2,0340 

5,31 

,5636 

-2,5322 

30. 0 

51,93 

2,0979 

4,97 

,5670 

-2,3603 

30.2 

51.47 

2.1625 

4,65 

,5706 

-2,2022 

30.4 

51.05 

2,2281 

4,36 

,5742 

•2,0546 

30.6 

50.65 

2,2947 

4,09 

,5779 

•1,9179 

30.8 

50.28 

2.3619 

3,04 

.5819 

-1,7923 

31. 0 

49.93 

2,4396 

3,62 

,5862 

-1,6701 

31.2 

49.61 

2,4989 

3,40 

3,20 

,590b 

,5950 

-1,5605 

31.4 

49,30 

2.569? 

-1,4673 

31.6 

49.02 

2.6409 

3,01 

,5996 

-1 ,37 13 

31.8 

48,75 

2,7132 

2,83 

,6046 

-1,2042 

32.0 

<10.51 

2,7867 

2,07 

f6Q98 

-1,2027 

32.2 

48.27 

2,8622 

2,51 

,6150 

•1,1236 

32.4 

40.06 

2,9301 

2,37 

,6207 

•1,0534 

3?. 6 

47  .65 

3,0161 

2,23 

,6265 

-,9851 

32.8 

47,66 

3,0*54 

2,10 

,632  7 

-,9215 

33.0 

47. 4» 

3 , 1 7t»t 

1,98 

,6391 

-.8630 

MTU 


023ft 
0239 
024ft 
1)253 
02ft  0 
U266 
0276 
026* 
0252 
0301 
0311 
0320 
0330 
0341 
0352 
0364 
03  76 
0 3ft  V 
0403 
0417 
0432 
0440 
0*6  4 
0462 
0501 
0520 
05  4,1 
0563 
0567 
0612 
0639 
0667 
0650 
0731 
0766 
0B04 
0045 
0090 
0V36 
0 V9  0 
1046 
110V 
1170 
1255 
1339 
1431 
1530 
1659 
1751 
1945 
2122 


162 


RATIO 

TOTAL 

STEP 

VAR 

VAH 

CQVAR 

MTTF- 

ERROR 

SIZE 

ERROR 

STEP 

33.2 

47.32 

3.2565 

1,87 

,6458 

-.8071 

,2331 

33.  4 

47,16 

3.3431 

1,76 

.6528 

- ,7540 

,2580 

3.3.6 

47.01 

3. 4?«4 

1,66 

,6602 

-,7047. 

,267  7 

33. S 

46.66 

3.5175 

1,56 

,6679 

- , 6566 

,3240 

34.0 

46,75 

3,6079 

1,47 

,6760 

-,61.50 

,3697 

34.2 

46,63 

3,7002 

1,39 

,6846 

-.5748 

,42/8 

34.4 

46,52 

3 . 70bi 

1.31 

,6936 

-,5366 

,5059 

34,6 

46,42 

3,8927 

1,23 

,7031 

• , 5005 

,6161 

34,8 

46.32 

3,9^32 

1,16 

,'130 

-.4665 

, 7633 

35.0 

46,23 

4 , 0?63 

1,09 

,7  235 

-,4348 

1,0636 

35.2 

46.15 

4,2026 

1,03 

,7345 

-,4053 

1,6336 

35.4 

46,07 

4,3121 

,*7 

, 7463 

-.3777 

3,4236 

Column  1 is  the  ratio  Ki-lJXj/EXj 

Column  2 1b  the  estimate  for  the  total  irror  content 

Colusn  3 1b  the  normed  estimate  for  step  size:  In  order  to  determine  the 
actual  estimate  for  the  step  size,  the  entry  in  this  column  should  be  divided 
by  the  total  observation  time  T. 

Column  I*  Is  the  approximate  standard  deviation  of  the  estimate  of  the  total 
error  content. 

Column  5 Is  the  normed  standard  deviation  of  the  estimate  of  the  step  size: 

In  order  to  obtain  the  actual  standard  deviation  the  entry  in  this  column 
should  be  divided  by  the  total  time  T. 

Column  6 Is  the  normed  covariance  between  II  and  +:  in  order  to  obtain  the 

actual  estimated  covariance  the  entry  should  be  divided  by  T. 

Column  7 Is  the  normed  MTTF  and  in  order  to  obtain  the  actual  value  the 
entry  should  be  multiplied  by  T. 


h i 17 


RATIO 

TOTAL 

hR*0& 

5 TL-P 
SI7h 

VAR 

ERROR 

VAR 

STfcP 

tOVA« 

MTTF 

23.2 

943.21 

.O^ll 

9101,99 

.5055- 

4600 

,2636 

,021b 

23.4 

483.36 

?274 ,76 

,5n56- 

1149 

,07q3 

,0224 

23.6 

33q  ,12 

,1533 

1009,09 

,5o57 

• 510 

,1690 

,0230 

23.  ft 

253.66 

.2045 

567,8n 

, 5|)60 

• 20° 

,7948 

,0237 

24.g 

207.79 

.2557 

362,85 

,5062 

■ 1 8 3 

,1011 

,0243 

24.2 

1 7 7 , 2 9 

, 3 o7  o 

251,65 

,5066 

-126 

,98  74 

, 023 0 

24.4 

155,54 

.3564 

104,52 

.5070 

• 94 

,0554 

,0257 

24.6 

139,27 

.4099 

140,99 

,5075 

• 71 

,0309 

,0264 

24  , ft 

1 ? 6 , 6 7 

1 46j  4 

111  1 21 

, 5 Q 8 2 

-06 

• 0121 

, 0272 

25,0 

116.59 

,5131 

ft9 , 0? 

,5067 

• 45 

,1961 

,0200 

25.2 

ljS.39 

,3649 

74,04 

,5095 

•37 

,2239 

, 0288 

25.4 

l'Jl . 58 

,6t7o 

62,01 

,5102 

• 31 

,1423 

, 029  7 

25.6 

>S.b4 

,6691 

52,66 

,5111 

• 26 

,4190 

, 0306 

25. 8 

90.95 

.7214 

45,26 

.5121 

-22 

,6012 

,0315 

26.0 

86,73 

,>739 

39,27 

,>130 

,5140 

'19 

,6551 

,0325 

26.2 

83.05 

,3260 

34,36 

• 17 

,1679 

,0336 

26.4 

79,0? 

,0790 

30,30 

,5152 

• 15 

,1159 

,0345 

26,6 

76,9ft 

,9  530 

?6,9ij 

,5164 

• 13 

,3998 

,035b 

26,  ft 

74,45 

,9863 

24,33 

,51/8 

• 11 

,9531 

, 0369 

27.0 

72.19 

1 • 3 4 0 13 

21,50 

,5192 

• 10 

,7134 

,0302 

27.2 

70 . 1-* 

1.0943 

19,45 

1 5?0> 

*9 

,6342 

,0390 

27.4 

60,33 

1,1  104 

17,6? 

,5?22 

-0 

• 7167 

»U«Qb 

27  ,6 

66  . oo 

1.2032 

16,02 

,5?  jb 

•7 

,9054 

,0*23 

27.  ft 

65.16 

1,2581 

14.6? 

,5255 

• 7 

.2017 

,043b 

2ft.  j 

63,78 

1.3138 

13,38 

,5273 

• 6 

,5751 

, 0454 

29.2 

62,5? 

1,3695 

12,28 

,5?92 

,5312 

• 0168 

, 0471 

29,4 

61.37 

1,4255 

11,31 

p5 

,5277 

,0400 

28.6 

*0.30 

i , 4824 

10,42 

,5332 

• 5 

. oe  00 

,0507  ' 

2fl . ft 

59,33 

1.6395 

9,64 

,5354 

• 4 

,6839 

,0527 

29.0 

68,43 

1.5968 

8,93 

,5370 

• 4 

,3308 

,0948 

‘29.2 

57.60 

1,6551 

8,29 

,5400 

m 4 

,0037 

, 0970 

29.4 

56,fl3 

1.713ft 

7,71 

,5420 

«ti 

,7100 

,0094 

29,6 

56.11 

1,7727 

7,lfl 

,5452 

w 3 

,4458 

.,8219 

29.9 

65,45 

1.8325 

6,69 

,3479 

• 3 

,2013 

, 0646 

3o.n 

54,fl3 

1,3930 

6,25 

.5507 

• 2 

,9771 

,0673 

30.2 

64,28 

1,9539 

5,64 

,5536 

• 2 

,7739 

,0709 

30.4 

53,72 

2,0153 

5,47 

,5568 

• 2 

,5872 

,0738 

30.6 

53.22 

2,0776 

5,13 

,5600 

m2 

,4145 

,0774 

30. « 

52,75 

2,14U 

4,81 

,5632 

*2 

,2523 

,0»12  . 

31 .0 

52.32 

2,2050 

4,51 

,5667 

*2 

• 1044 

,0893 

31.2 

51.91 

2.2696 

4,24 

,5703 

•1 

,9676 

,0898 

31.4 

5i,53 

2,3349 

3,99 

,5742 

•1 

• 8421 

,0946 

,099ft 

31.6 

51.17 

2,4012 

3,75 

,5781 

•1 

,7247 

31.8 

50.84 

? , 4683 

3,53 

,5823 

•1 

,6154 

,1039 

32.0 

60.53 

2,5370 

3,32 

,5864 

•1 

,5113 

,1116 

32.2 

60.23 

2.6063 

3,13 

,5909 

-1 

,4159 

,1187 

32.4 

49,96 

2,6769 

2,95 

,5955 

•1 

• 3260 

,1263 

32.6 

49.70 

2,7479 

2,7ft 

,6005 

•1 

,2443 

,1346 

32.8 

49,46 

2,8207 

2,6? 

,6056 

•1 

• 1663 

,1440 

33.0 

49.23 

2 , 895c 

2,47 

,6107 

•1 

• 0917 

,1946 

33.2 

49.02 

? 1 9 7 1 2 

2,34 

,6163 

•1 

• 0233 

,1664 
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ratio 

total 

l-RRUR 

‘jffcP 

Z\7l 

VAR 

FR‘iOR 

VAR 

bTEP 

CQV  AP 

MTTF 

33.4 

48,83 

3,0465 

2,20 

,6221 

•,9601 

,1796 

33.  A 

46,64 

3,1251 

2,05 

.6281 

-,8983 

,1952 

33.8 

48,47 

3,2047 

1,96 

,6344 

" i 84 i7 

34 . 0 

48,30 

3 .2855 

1,65 

,6410 

-,7888 

,2334 

34  .? 

48.15 

3,3691 

1.75 

,64/9 

-,7380 

,2560 

34.4 

48,01 

3.4538 

1,65 

,6552 

- ,6Slii 

,2671 

34.6 

47.67 

3.54C5 

1,36 

,6628 

-,6469 

,3228 

34.8 

47,75 

3.6297 

1,47 

,6706 

- , 6044 

,3660 

35.0 

47,63 

3,7206 

1,39 

,6790 

- , S>655 

: ,4249 

35,2 

47,5? 

3.8141 

1,31 

,6878 

-,5283 

,5015 

35,4 

47.4? 

3.9101 

1,23 

,6969 

-.4932 

,6066 

35.6 

47,33 

4,0063 

1,16 

,/067 

- , 4610 

,7662 

35,8 

47.24 

4.1C96 

1,09 

,7169 

-,4303 

1,0282 

36  . o 

47,15 

4.213‘? 

1,03 

, 7277 

-.4015 

1,5463 

36.2 

47,00 

4 i 3 ? 1 4 

,97 

, 7390 

-,3745 

3,0440 

36.4 

47,00 

4,4325 

*91 

,7510 

- ,3491 

62,9168 

t 


I 


Column  1 la  the  ratio  I(l-l)Xi/rX1 

Column  2 la  the  estimate  for  the  total  ^rror  content  - •— 

Column  3 la  the  normed  estimate  for  step  site:  In  order  to  determine  the 
actual  estimate  for  the  step  size,  the  entry  in  this  column  should  be  divided 
by  the  total  observation  time  T. 

Column  b la  the  approximate  standard  deviation  of  the  estimate  of  the  total  j 

error  content.  

Column  5 Is  the  normed  standard  deviation  of  the  estimate  of  the  step  size:  | 

in  order  to  obtain  the  actual  standard  deviation  the  entry  in  this  column 
should  be  divided  by  the  total  time  T. 

Column  6 ia  the  normed  covariance  between  II  and  dt  in  order  to  obtain  the 

actual  estimated  covariance  the  entry  should  be  divided  by  T.  

Column  7 Is  the  normed  IfTTF  and  in  order  to  obtain  the  actual  value  the 
entry  should  be  multiplied  by  T. 
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RATIO 

TOTAL 

ERROR 

step 

SIZE 

VaR 

ERROR 

VAR 

STtP 

CUVAR 

MTU 

24.0 

407,74 

• l"5l 

1533,91 

,5003 

*766,9430 

, 0222 

24.2 

2®6.24 

.1752 

782,1(1 

.5005 

-390,9612 

,0228 

24.4 

237.45 

.2253 

47?,47 

,50Q7 

•236,0714 

,0234 

24.6 

198,86 

.2755 

315,99 

,5011 

•157,8362 

, 0241 

24.fi 

172.16 

,3257 

225,64 

,5014 

•112,7420 

,0247 

25.o 

152.64 

.3761 

169,33 

,5019 

-84,4628 

,0254 

25.2 

137.75 

. .4265 

131,60 

,5024 

-65,6191 

,0261 

25,4 

126.04 

,4770 

105,13 

,5030 

-52,3846 

,026V 

25,6 

116,56 

.5277 

85,80 

.5036 

• 42.7U6 

,027ft 

25.fi 

108,78 

,5785 

71,35 

,5043 

-35,4843 

, oxe  4 

26.0 

102,26 

.6294 

60,20 

,5051 

-29,9127 

,0293 

26.2 

96,73 

, 6 0 c 5 

51,44 

,5059 

-25,5260 

,0302 

26,4 

9i,99 

.7319 

44,42 

,5068 

-22,0162 

,0311 

26,6 

87,88 

.7832 

36,74 

,5078 

•19,1795 

,0320 

26,6 

84.29 

.8350 

34,04 

,3088 

•16,8266 

,0330 

27.0 

81.12 

,8869 

30,13 

.5100 

-14,6711 

, 0340 

27.2 

78,32 

,9389 

26,84 

,5112 

•13,2286 

,0351 

27.4 

75,81 

.9914 

24,03 

,5124 

-11,6212 

,0363 

27,6 

73.58 

1,0*40 

21,63 

,5130 

-10.6246 

, 0375 

27.6 

71.56 

1,0969 

19,56 

,5152 

-9-, 5912 

, 0387 

28.0 

69,73 

1.15C2 

17,75 

,5167 

-8,6e7l 

,0400 

28.2 

68,08 

1.2036 

16,18 

,5183 

-7.9024 

,0414 

28.* 

66,57 

1,2576 

14,79 

,5200 

-7,2056 

, 0428 

28.6 

65,19 

1.3123 

13,55 

,5216 

-6,5676 

,0444 

28.8 

63.92 

1.3667 

12,46 

,5234 

•6,0397 

, 0460 

29,0 

62.77 

1,4213 

11,50 

,5255 

-5 , 56 16 

, 0476 

29.2 

61, 7l 

1,4767 

10,62 

,5275 

-5,1256 

.0494 

29,4 

60.72 

1 » 53?5 

9,83 

.5296 

•4,732e 

,0513 

29.6 

59.81 

1.5891 

9,12 

,5317 

-4,3749 

,0533 

29,8 

58,96 

1,6459 

8,47 

,5340 

•-4,0525 

,0554 

<10,0 

58,18 

1,7033 

7,89 

,5364 

-3,7598 

, 0577 

<10.2 

57,46 

1,7606 

7,36 

,5390 

•3,4970 

,0600 

•10,4 

56,78 

1,6195 

6,86 

,5414 

*3,2503 

,0626 

>10.6 

56,15 

1,6764 

6,42 

,5442 

-3,0264 

,0653 

>10.6 

55,57 

1,9380 

6,01 

,5470 

-2,8235 

, 0662 

31.0 

55,0? 

1,9981 

5,63 

,5500 

-2,6361 

,0713 

<11.2 

54,51 

2,0590 

5,23 

,5530 

•2,4626 

, 0746 

<11.4 

54.04 

2.12C3 

4,96  • 

,5563 

• 2 , 3037 

,0781 

31.6 

53,59 

2,1825 

4.66 

,5596 

•2,1555 

..  ,«hl9 

3i.8 

53.18 

2,245< 

4,38 

,5631 

-2,0186 

, 0860 

32.0 

52.78 

2.3094 

5,12 

,5666 

•1,8696 

,0905 

32.2 

52.42 

2,3733 

3,89 

,57  C5 

-1,7723 

,0953 

,1006 

32.4 

52,00 

2.4396 

3,66 

,5743 

-1,6399 

32.6 

51.75 

2.5Q61 

3,45 

,5783 

•1,5562 

,1063 

32.8 

51.45 

2,5732 

3,23 

,51827 

• 1 ,4613 

,1125 

33.0 

51,17 

2.6422 

3,07 

,5869 

-1,3686 

,1195 

33.2 

50.90 

2.7U4 

2,90 

,5916 

•1,2652 

,1270 

33.4 

50.66 

2.7017 

2,74 

,5965 

*1,2069 

,1354 

33.6 

50.4? 

2,8533 

2,58 

,60l5 

-1,1331 

,1447 

33.8 

50.2C 

2.9268 

2,44 

,6066 

-1,0616 

,1553 

34.0 

50, 00 

3. COO9 

2,30 

,6120 

-,9965 

,1670 
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RAT  in 

total 

ERROR 

STfcP 

sizt 

VAR 

ERROR 

VAR 

STEP 

COVAR  ... 

_.mttf 

34,2 

49.  80 

3,0766 

2.18 

,6177 

-,9348 

,1804 

34.4 

49.62 

3.1537 

2,06 

, 6236 

-.8767 

,1957 

J4 .6 

49,45 

3,2320 

1,94 

,6299 

-,8230 

,.2l3i 

,14. a 

49,29 

3,3122 

1,»« 

,6363 

-,7716 

,2337 

>15.0 

49.14 

3,3938 

1,74 

,6431 

-,72J7 

,2577 

>15.2 

49,00 

3,4774 

1,64 

,6502 

-,6782 

.2666 

35.4 

48,87 

3,5631 

1,55 

,6576 

-,6350 

,3220 

35.6 

48.75 

3,6506 

1,46 

,6654 

-,5946 

,3660 

35,8 

48.63 

3.74  02 

1,3» 

,6735 

-,5566 

...  ,1*20 

36.0 

48,53 

3.3321 

1,30 

,6821 

-,5207 

,4962 

36.2 

48,42 

3,9264 

1,23 

,69H 

• 1 4668 

,5995 

36,4 

43,33 

4,0231 

1,16 

,7005 

-,4554 

, 7508 

36,6 

48,24 

4,1226 

1,10 

,'105 

-.4256 

,9975 

36.  A 

48,16 

4,2?52 

1,03 

,'209 

-,3973 

1,4755 

37,0 

48,08 

4,3308 

,97 

,'319 

-,3710 

2,7655 

37.2 

48.01 

4,4195 

,92 

,'435 

-,3465 

18,6390 

* 


i 

I 

f 

I 

I 

I 

I 

I 


Colunn  1 Is  the  ratio  lli-DXj/tXj 

Column  2 la  the  estimate  for  the  total  irror  content 

Column  3 la  the  normed  estimate  for  step  size:  in  order  to  determine  the 
actual  estimate  for  the  step  size,  the  entry  in  this  column  should  be  divided 
by  the  total  observation  time  T. 

Column  It  is  the  approximate  standard  deviation  of  the  estimate  of  the  total 
error  content. 

Column  3 is  the  normed  standard  deviation  of  the  estimate  of  the  step  else: 
in  order  to  obtain  the  actual  standard  deviation  the  entry  in  this  column 
should  be  divided  by  the  total  time  T. 

Column  6 Is  the  normed  covariance  between  II  and  4:  in  order  to  obtain  the 

actual  estimated  covariance  the  entry  should  be  divided  by  T. 

Column  7 is  the  normed  IfTTF  and  in  order  to  obtain  the  actual  value  the 
entry  should  be  multiplied  by  T. 
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N s 40 


RATIO 

total 

error 

step 

SI29 

VaR 

ERROR 

VaR 

bT£P 

CQVaR 

MTJK 

24,2 

1024.1? 

,0^90 

ICO’’, 08 

,4950" 

4998, 387B 

, 0209 

24.4 

524.31 

, 0 *9  8 0 

2524,:)? 

,4951- 

1249,1009 

,0215 

24. A 

357. 6l 

,1*71 

1121,15 

,4952 

•554,7390 

. ,0220 

24. ft 

274.64 

, l^ei 

6 3 0 , 1 7 

,495b 

-311,7258 

, 0226 

25  , o 

224.79 

,2153 

402,82 

,4957 

•199,1845 

,0232 

25.? 

l’l.M 

,2944 

.3437 

279,43 

,4961 

-130,1182 

,0238 

25.4 

167.97 

204,9? 

,4964 

•101.2297 

, 0245 

25.6 

l5Q,29 

,3930 

156,67 

,4969 

•77,3569 

, 0251 

25 , 6 

136,56 

, 4424 

123,52 

,49/4 

• 6 1) , 9 4 8 1 

,025(? 

26.0 

125.60 

, 4920 

99,81 

, 4980 

-49,2052 

, 0265 

26 .? 

116.67 

,5416 

32,28 

,4906 

•40,5297 

, 0273 

26.4 

109,25 

. 59 1 4 

60,94 

,4993 

•33,9285 

, 0281 

26.6 

102,99 

,6414 

58,55 

50,32 

, 5001 

•28,7633 

, 0289 

26.8 

97.66 

. 69i5 

,50Q9 

•24,7082 

, 029/ 

27. C 

93.07 

,7417 

43,69 

1 5 Q 1 8 

•21,4333 

. 0 JO 5 

27.2 

*9,06 

,7921 

38,26 

,5028 

•10,7424 

,0J15 

27.4 

85.54 

,8428 

33,75 

29,97 

,5038 

•16,5128 

, 0J25 

27.6 

82.43 

,8937 

,?049 

-14.6426 

, 0 J J5 

27.8 

79,67 

,9447 

26,78 

,506). 

•13,0632 

, 0 J45 

28.0 

77.19 

,9961 

24,05 

, 5073 

•11,7095 

, 0 J5 6 

28,? 

74,97 

1,0473 

21,69 

,5086 

•10,5452 

, 0368 

28.4 

72.96 

1, C9V7 

19,65 

,5099 

•9,5350 

, 0300 

28.6 

71.14 

1 ;i.5l9 

17,88 

,5U4 

-8,6569 

,0J92 

28,8 

69.49 

1,2043 

16,33 

.5129 

•7,8887 

, 0405 

29.0 

67.98 

1,2571 

14,95 

,5146 

•7,2102 

,0419 

29.2 

66.60 

1,3100 

• 13,74 

,5163 

- 6 , 6 1 1 6 

, 0434 

29.4 

65,34 

1,3436 

12,65 

,5181 

-6,0736 

, 0449 

29.6 

64,16 

1,4177 

11,67 

,5198 

•5,5877 

, 0465 

29.8 

63,10 

1,4715 

10,81 

,5219 

•5,1636 

, 0462 

>*0.0 

62,11 

1,5262 

10,02 

,5239 

-4,7745 

, 0500 

JO.? 

61.18 

1 , 58 1 5 

9,31 

,5260 

•4,4208 

,0519 

JO. 4 

60.31 

1,6369 

8,66 

,5002 

•4,1031 

,0539 

JO, 6 

59,54 

1.6930 

8,07 

,5305 

•3 , 8 1 i3 

,0560 

JO. 8 

58.81 

1,7496 

7,53 

,5329 

*3,5.459 

,0963 

Jl.O 

58.12 

1,8069 

7,04 

,5353 

•3,3011 

, 0607 

31,2 

57,49 

1,8642 

6,59 

,5380 

• 3 , 0 8 13 

,0632 

31.4 

56,89 

1,9?26 

6,17 

,3407 

•2,8751 

, 0660 

31.6 

56,33 

1.9814 

5,79 

,5435 

•2,6866 

, 0689 

31.8 

55,81 

2,0403 

5,44 

,5464 

*2,5124 

, 0720 

32. 0 

55,33 

2,1007 

5,11 

,5495 

•2,3528 

, 0753 

32.2 

54.87 

2,1614 

4,81 

,5527 

•2,2043 

, 0768 

32.4 

54,44 

2,2232 

4,52 

,5559 

•2,0636 

,0827 

32.6 

54.05 

2,2849 

4,27 

, 5595 

•1,9382 

,0867 

32.8 

53.67 

2.3480 

4,02 

,5630 

•1,8175 

,0912 

33,0 

53,3? 

2.4H9 

3,79 

,5667 

*1,7054 

33.2 

52,99 

2,4764 

3,58 

,5707 

•1,4020 

,1013 

33.4 

52.68 

2,5421 

3,38 

,5747 

•1,5041 

,1070 

33,6 

52,38 

2,6088 

3,19 

,5788 

•1,4120 

,1133 

33.8 

52,11 

2,6765 

3,01 

,3831 

•1,3258 

,1202 

34. C 

51.85 

2,7451 

2,85 

,5*77 

•1,2457 

,12  7 8 

34.? 

51,61 

2,8143 

2,69 

,592? 

•l,17ifi 

,1361 
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RATJP 

total 

FRROR 

STl.H 

size 

VAR 

ERROR 

YAH 

STEP 

C0Ya« 

PT?F 

34.4 

*1.33 

2,6851 

2,55 

,5974 

-1,1010 

,1454 

34.4 

*1.17 

2,9575 

2,41 

,6025 

ml.,  0334 

,1559 

34.8 

50f97 

3 , C 3 0 4 

2,28 

,6079 

-,9718 

,1676 

35.0 

50.78 

3,1053 

2,15 

,63.34 

-,9120 

,iblo 

35.2 

50.60 

3,1*09 

2,04 

.6193 

-,8576 

,1959 

35.4 

50.44 

3 ,2563 

1,93 

,6254 

-,B054 

.2J.33 

35 . 6 

50.26 

3.3375 

1,52 

,P3l7 

-,7555 

,2338 

35,6 

*0.13 

3,4162 

3,5006 

1,72 

,63b4 

-,7069 

,.2578 

36 . 0 

*0, 0C 

1,63 

,0453 

- 1 6650 

36.? 

49.87 

3.5548 

1,54 

,6526 

*,6238 

,3211 

36,4 

49.75 

3 , 6 7 0 8 

3 ,46 

,6602 

-,5850 

,3040 

36.6 

49,64 

3,7590 

1,38 

,6662 

-,5464 

,4ie6 

36.8 

49,53 

3,6494 

1,30 

,0766 

- ,5137 

,490» 

37.0 

49.43 

3.5423 

1,23 

,6853 

- , 48  q5 

,5910 

37.? 

49,34 

4,0374 

1,16 

,6945 

- , 4499 

,7362 

37.4 

49,25  . 

4,1351 

1,10 

,7042 

-,4?U 

,9684 

37.6 

49.17 

4,2357 

1,04 

,7144 

- 1 3938 

1.4034 

37,8 

49,09 

4,3394 

,98 

,'251 

• ,3681 

2, 5p5b 

38,0 

49.02 

4,4461 

,92 

,'364 

- , 3441 

10,7436 

Column  1 is  the  ratio  E( i-1 JXj/EXj 

Column  2 is  the  estimate  for  the  total  ^rror  content 

Column  3 is  the  normed  estimate  for  step  size:  in  order  to  determine  the 
actual  estimate  for  the  step  size,  the  entry  in  this  column  should  be  divided 
by  the  total  observation  time  T. 

Column  k is  the  approximate  standard  deviation  of  the  estimate  of  the  total 
error  content. 

Column  5 is  the  normed  standard  deviation  of  the  estimate  of  the  step  size: 
in  order  to  obtain  the  actual  standard  deviation  the  entry  in  this  column 
should  be  divided  by  the  total  time  T. 

Column  6 is  the  normed  covariance  between  II  and  4:  in  order  to  obtain  the 

actual  estimated  covariance  the  entry  should  be  divided  by  T. 

Column  7 is  the  normed  Ifl'PF  and  in  order  to  obtain  the  actual  value  the 
entry  should  be  multiplied  by  T. 
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— 

RATIO 

total 

error 

STEF' 

SIZE 

VAR 

URKOR 

vaR 

STEP 

CQVA0 

MTTF 

25 . o 

441.38 

. 1?01 

1698,57 

, 4902 

•832,0596 

,0213 

25,? 

322.58 

, 1 6 8 1 

866,34 

,4904 

-424,3369 

,0210 

25.4 

2^6,6? 

,?162 

523,53 

, 4906 

•256,3369 

, 0224 

25,6 

214.69 

, 2644 

349,95 

,490* 

•171,2654 

,0230 

w 

25.8 

1^5,73 

,3126 

260,25 

,4912 

•122,4235 

,0236 

26.0 

164,54 

,36q9 

137,6? 

,*♦916 

•91,7763 

, 0242 

26.2 

146,35 

. 4093 

145,81 

,4920 

-71,2472 

, 0248 

w 

26.4 

135.63 

,4577 

116,54 

,4926 

•56,9098 

, 0255 

26,6 

125,35 

,5363 

95,18 

,4932 

•46,4448 

,02C  2 

26.8 

116.88 

,5551 

79,11 

,493« 

•36,5631 

, 0269 

w 

27,0 

lO’.SO 

,6039 

• 66,70 

,4945 

•32,5237 

, 0277 

27.2 

103,79 

,6828 

57,09 

,4953 

,4961 

•27,7704 

,0285 

27.4 

98.63 

. 7020 

49,32 

-23,9609 

, 0293 

27.6 

94.15 

, 7 3 1 4 

42,99 

,4969 

•20,8609 

, 0301 

27,8 

’0.24 

,03G* 

37,01 

,4979 

,4908 

•10,3301 

,0310 

28.0 

86,79 

.8505 

33,46 

•16,1905 

, 0320 

w' 

28.2 

83,73 

.9003 

29,82 

, y o o o 

*14,4175 

, 0329 

28,4 

fll.Gl 

,9604 

26,73 

,?nii 

•12,9037 

, 0339 

28,6 

7b, 56 

1.0003 

24,06 

,5023 

•11,5931 

, 0350 

28.0 

76.36 

1 ,05l3 

21,7  7 

,5036 

•10,4747 

,0361 

29.o 

74.36 

1,1023 

19,76 

,?049 

•9,4888 

, 0372 

29.2 

7?. 58 

1,1533 

1«,02 

,?063 

-8,6370 

,0384 

N— 

29.4 

70.90 

1.2047 

16,48 

,5079 

• 7 ,8560 

, 0397 

29.6 

69.39 

1.2566 

15,12 

,5094 

•7,2155 

,o«io 

29.8 

68. Cl 

1,3085 

13,91 

,5110 

-6,6264 

, 0424 

W 

30.0 

66.74 

1 ,360* 

12,33 

,5128 

-6,0992 

,0*39 

30.? 

65,57 

3 ,4\36 

11,86 

,5146 

•5,6247 

, 0454 

30.  A 

64,48 

1,4670 

10,99 

,5163 

*5,1944 

, 0471 

30.6 

63.48 

1,5206 

10,20 

,5103 

-4,0009 

,0*08 

30.3 

6?,55 

1,5746 

9,48 

,5203 

•4,4597 

,0506 

31.0 

61.7c 

1.6286 

8,84 

,5225 

•4,1470 

, 0525 

31.? 

60.9c 

1.6836 

6,25 

i 5 ?4  7 

•3,0563 

, 0545 

31.4 

60.15 

1,7389 

7,71 

,5270 

•3,5924 

,0566 

31.6 

59,46 

1,7949 

7,21 

,5?94 

*3,3495 

,0509 

31.6 

5fa. e 1 

1 ,«5ii 

6,76 

,5319 

-3,1201 

,UM3 

32.0 

58,21 

1,907V 

6,34 

,5345 

•2,9243 

,063V 

• 

32.? 

57,64 

1,9655 

5,95 

,5372 

*2,7348 

,0666 

32.4 

57,11 

2,0232 

5,60 

,5401 

*2,5635 

,0095 

32.6 

56,61 

2,0«22 

5,26 

,5429 

*2,3996 

, 0726 

32,8 

56,15 

2,1414 

4,95 

,5460 

-2, 2507 

,0759 

33.0 

55.7? 

2.2011 

4,67 

,5493 

-2,1134 

,0795 

33.2 

55,31 

2 , 26 1 7 

4,40 

,5526 

-1,9843 

,0033 

33,4 

54.92 

2,323? 

4,16 

,5560 

•1,8637 

, 0074 

33.6 

54.56 

2,3852 

3,9? 

,5596 

*1,7516 

,oviv 

33,8 

54,2? 

2,A4«5 

3,70 

,5632 

*1,6452 

0V68 

34,0 

53.90 

2,5122 

3,50 

,5671 

-1,5478 

,1020 

34.2 

53.60 

2,5774 

3,31 

,5709 

-1,4535 

,1078 

34.4 

53,3? 

2,6431 

3,13 

,5751 

-1,3(70 

,1141 

34.6 

53. C5 

2,7093 

2,96 

,5795 

-1,2875 

,1200 

34.8 

52.00 

2,7771 

2,80 

,584  0 

*1,2110 

,1204 

35.  J 

52,57 

2,6461 

2,85 

,5886 

-1,1304 

,1366 

170 
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RATIO 

TOTAL 

RTfP 

VAR 

VAB 

cgvA* 

Mm 

>• 

{•kruR 

JJ2L 

RRROR 

5T£P 

35.2 

52.35 

2.9160 

2,51 

,5934 

rl,0708 

,1461 

35.4 

52.13 

2.9H7G 

2,38 

,5985 

•1,0074 

,1565 

35.6 

51,94 

3,0592 

2,25 

,0038 

-,9477 

,1682 

35.8 

51.76 

3,1327 

2,13 

,0093 

- , 89 16 

, 1513 

36.0 

51.59 

3,2075 

2,02 

,6151 

-,8366 

,1963 

36.? 

51.43 

3 , 2P  4 0 

1,9.\ 

,6210 

• , 7880 

,2137 

36.4 

51.27 

3,36i9 

1,81 

,0273 

•>,  7407 

,2337 

36.6 

51.13 

3, 4 41 5 

1,71 

,6338 

-,.6955 

,2575 

36.8 

50,99 

3,5228 

1,62 

,6406 

•,6531 

,2858 

37.0 

50, 87 

3,6056 

1.54 

,6477 

-,6136 

,3157 

' i 

37.2 

50.75 

3 , 69  o 7 

1,45 

,6551 

- , 5754 

,3624 

37.4 

5o.64 

3,7775 

1,38 

,6629 

- , 5356 

,4i6g 

1 

37,6 

50.53 

3,8662 

1,30 

,67H 

•v , 5 0 6 7 

,4857 

37.8 

50.43 

3.9575 

1,23 

,079  1 

-,4748 

,5821 

1 

38.0 

50,34 

4,0510 

1,16 

,6887 

-,4451 

, 7 2 Q 6 

38.2 

50.26 

4,i475 

1,10 

,6981 

-,4164 

,9434 

{ 

38.4 

50.18 

4.2461 

1,04 

,98 

,'080 

- , 39  01 

1,3421 

1 

38,6 

50,10 

4.3478 

,7184 

-,3651 

2,3013 

1 1 

38.8 

5C.C3 

4,4528 

,93 

, 7293 

- , 3 4 1 4 

7,7463  > 

*/ 

I 


| Column  1 i8  the  rntio  £( l-lJXj/EX^ 

Column  2 Is  the  estimate  for  the  total  irror  content 

I Column  3 is  the  normed  estimate  for  step  size:  in  order  to  determine  the 

actual  estimate  for  the  step  size,  the  entry  in  this  column  should  be  divided 
by  the  total  observation  time  T. 

I Column  U is  the  approximate  standard  deviation  of  the  estimate  of  the  total 

error  content. 

Column  5 is  the  nomed  standard  deviation  of  the  estimate  of  the  step  size: 

(in  order  to  obtain  the  actual  standard  deviation  the  entry  in  this  column 

should  be  divided  by  the  total  time  T. 

Column  6 is  the  nonaed  covariance  between  II  and  <p:  in  order  to  obtain  the 

actual  estimated  covariance  the  entry  should  be  divided  by  T. 

Column  7 is  the  normed  IflTF  and  in  order  to  obtain  the  actual  value  the 
entry  should  be  multiplied  by  T. 
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RATIO 

total 

error 

STEP 

size 

VAR 

ERROR 

VaR 

STEP 

CO  VAR 

MTTF 

25.2 

‘Jfc'.-S 

.0471 

,4852*5417,0596 

, 0201 

25  .<1 

• u ^ 4 2 

,4853- 

1353, 7687 

, 0206 

25.6 

386,61 

, 1413 

1 239,46 

,4854 

•601,1754 

,0211 

25.8 

296,46 

,1084 

696 , 47 

,4856 

-337,6920 

,021* 

w 

26.0 

242.46 

.2356 

445,32 

,4858 

-215,0520 

,0222 

26.? 

2 f.  6 , 5 0 

.?829 

3nP ,83 

,4861 

•149,6256 

,022  7 

26,4 

1*0  , 88 

. 3 3 c 1 

226 ,en 

,4365 

-109,7397 

, U233 

W 

26,6 

161,70 

,3775 

173,24 

,4869 

-63,6509 

, 0239 

26.8 

146 ,6l 

.4250 

136,61 

, 4874 

-66,0027 

, 0246 

27,q 

134,93 

. 4 7?5 

110,42 

,4879 

-53,374b 

, 025  2 

W 

27.2 

125,25 

.5202 

91,05 

,4P,fl5 

-43,9771 

,0259 

27,4 

117.20 

,5679 

76,30 

,4891 

-36,0231 

,0266 

27.6 

110.^1 

,6159 

64,83 

,4898 

-31,2573 

, 0273 

27,8 

Hi 4 .6? 

,6639 

55,74 

.4906 

-26,6470 

, 0201 

28.0 

99,6? 

,7121 

46,38 

,4913 

-23,2769 

, 0209 

28.2 

95,26 

. 76  o5 

42,37 

,4922 

•20,3561 

, 0297 

28.4 

91.44 

,6091 

37,39 

,4931 

-17,9443 

,0306 

23.6 

86.06 

,e577 

33,23 

,4942 

-15,9284 

,0315 

28.8 

85.05 

, f,0e7 

29,69 

,4952 

-14,2103 

, 0324 

29.0 

82,36 

,9556 

26,68 

,4963 

-12,7507 

, 0334 

29.2 

79,93 

1,0053 

24,07 

, 4974 

*11,4049 

, 0344 

29.4 

77,75 

1.0548 

21,84 

,4987 

-10,4016 

, 0354 

w 

29.6 

75.77 

1,1040 

19, 68 

,5001 

-9,4527 

, 0365 

29.8 

73,97 

1.1547 

18,15 

,5014 

-0,6167 

, U 3 7 7 

>30.0 

72.31 

1,2054 

16,62 

,502« 

-7,0726 

,0309 

w 

3o  .2 

70.80 

1,2560 

15,28 

,5043 

-7 , 2213 

,040? 

•10.4 

69,42 

1,3070 

14,0« 

,5059 

•6,6423 

,041b 

• 

>10.6 

68,14 

1 , 3566 

13,00 

,5075 

-6,1162 

, 0429 

>10.8 

66,97 

1,4101 

12,04 

,5093 

-5,6537 

, 0444 

31*0 

65,69 

1.4619 

11,18 

,5112 

-5,2357 

, 0400 

31.2 

64.68 

1.5144 

10,39 

,5131 

-4,0540 

, 0476 

** 

31.4 

63.94 

1.5672 

9.68 

,5151 

•4,5090 

, 0493 

31,6 

63.C7 

1 , 6 2 C 5 

9,02 

,5171 

•4,1925 

,0511 

31.8 

62.26 

1.674? 

0,43 

,5192 

*3.9050 

,0530 

32.0 

6]  ,5l 

1,7265 

7,08 

,5214 

-3,6405 

,0551 

32.2 

6o , fan 

1,7831 

7,38 

,5237 

-3,3996 

, 0572 

32.4 

60.14 

1,6363 

6,92 

,5261 

-3,1762 

, 0595 

32.6 

59,53 

1,6936 

6,50 

,5287 

-2,9751 

,0619 

32.8 

58,95 

1.9500 

6,11 

,5312 

-2,7844 

,0645 

33.0 

56 . 42 

2,0065 

5,75 

,5340 

-2,6122 

,Uft72 

33.2 

57,9.1 

2.0642 

5,41 

,5367 

*2,4476 

,0701 

33.4 

57,43 

2. 1220 

5 ,3.0 

,5396 

-2,2963 

, 0732 

33,6 

56,99 

2 ,l8c3 

4,8i 

,5426 

-2,1571 

,0766 

•w 

33. d 

56.57 

2,2399 

4 ,54 

,5458 

-2,0280 

,0002 

34 . 0 

56,18 

2,2997 

4,29 

,5491 

-1,9074 

,0040 

34.2 

55.61 

2.3601 

4,05 

,5526 

-1,7956 

,0001 

34.4 

55.46 

2.4216 

3,83 

,5561 

-l,6e93 

,0926 

34.6 

55,13 

2,4841 

3,62 

3,43 

,5597 

•1,5868 

, 0975 

34.  B 

54.63 

2,5467 

,5636 

-1,4976 

,1026 

•*✓ 

35.0 

54,53 

2,6110 

3,25 

,5675 

-1,4090 

,10b4 

35.2 

54,26 

2.6759 

3,07 

,5715 

-1,3267 

,1147 
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RATIO 

total 

E:kR(iR 

5»  T t P 
ilZF 

VAR 

ERROR 

VAR 

STEP 

CgvAR. _ 

MTU 

35,4 

54.CC 

2.7416 

2,91 

,5758 

-1,2499 

,1215 

45.6 

r»  3 , 7 6 

2.H0M 

2,76 

,5B03 

*1,1772 

,1290 

35.6 

53.53 

2,e764 

2,61 

,5849 

-1 1 1086 

,1474 

36.0 

53.31 

2,9455 

2,48 

,5096 

'-1,0435 

‘,146  7 

36.2 

53.11 

3.0153 

2,35 

,5947 

-.9637 

,1569 

36.4 

52.52 

3,0071 

2,2  3 

,5998 

-.9252 

,1«87 

36.6 

52,74 

3 , 1 5 9 5 

2,11 

,6052 

-,87j,3 

,1817 

36.8 

52,57 

3,2336 

2,00 

,610» 

-.8199 

,1967 

37,0 

52,41 

3,3085 

l,’o 

,6168 

- . 7726 

,2136 

37.2 

52.26 

3,3854 

1,80 

,6229 

-.7267 

,2336 

37.4 

52.1? 

3,4638 

1,70 

,6293 

-,6835 

,236V 

37.6 

51,99 

3,543e 

1,62 

,6360 

-,6427 

, 2 M 4 6 

37,8 

51,87 

3,6257 

1,53 

,6429 

-,6037 

,3l8« 

38.0 

51,75 

3,7095 

1,45 

,6502 

-.5669 

,3601 

38  ,? 

51,64 

317947 

1,37 

,6*579 

-,5329 

.412Q 

38.4 

51,54 

3,8824 

1,30 

,6659 

-,5001 

,4604 

38.6 

51.44 

3,9723 

1,23 

,6742 

-,*691 

,5/36 

38.8 

51.35 

4 , q644 

1,17 

.6829 

-,4399 

, 7c 73 

35.0 

51.26 

4 ,1568 

1,10 

,6922 

*,4J27 

,9142 

39.2 

51,18 

4,2*561 

1,04 

.7018 

-,3866 

1,2848 

39.4 

' 5l.ll 

4.3559 

,99 

.,7119 

....  . -,3623 

...2, 1**3. 

39.6 

51.C4 

4.4588 

,93 

,7226 

-,3394 

5,8816 

Column  1 ia  the  ratio  E( i— lJX^/EX^ 

Column  2 Is  the  estimate  for  the  total  irror  content 

Column  3 Is  the  normed  estimate  for  step  size:  in  order  to  determine  the 
actual  estimate  for  the  step  size,  the  entry  in  this  column  should  be  divided 
by  the  total  observation  time  T. 

Column  1*  i3  the  approximate  standard  deviation  of  the  estimate  of  the  total 
error  content. 

Column  5 is  the  normed  standard  deviation  of  the  estimate  of  the  step  sizes 
in  order  to  obtain  the  actual  standard  deviation  the  entry  in  this  column 
should  be  divided  by  the  total  time  T. 

Column  6 is  the  normed  covariance  between  IJ  and  in  order  to  obtain  the 
actual  estimated  covariance  the  entry  should  be  divided  by  T. 

Column  7 is  the  normed  MTTF  and  in  order  to  obtain  the  actual  value  the 
entry  should  be  multiplied  by  T. 
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PATIO 

total 

furor 

STEP 

StZL 

VA« 
E R H 0 P 

STEP 

. CQVAR 

MTF 

26.0 

476,40 

.1155 

1874,04 

,4806 

•900.2390 

, 0204 

26.? 

347.83 

,3  ft  1 7 

955,33 

, 480B 

-459,7669 

, 0209 

26,4 

276,48 

.2079 

577,4(1 

,4010 

-277,2057 

,0214 

?6 , 6 

23l .14 

.2542 

386  , i5 

,4812 

-185,3299 

,0220 

26.  A 

199.61 

, 3006 

276,17 

,4016 

-132,4968 

, 0225 

27.0 

176  66 

,3470 

207,00 

.4019 

p99,2951 

, 0231 

27.2 

159,36 

.3934 

160,99 

,4824 

-77,1579 

, 0237 

27.4 

145.58 

. 4400 

128,64 

,4826 

*01,0129 

, 024  3 

27,6 

134.43 

, 4*168 

105,03 

87,37 

73,75 

,4833 

-50,2632 

,0249 

27.0 

125.27 

,5335 

,0039 

-41,7821 

, 025  6 

2e , o 

117.59 

, 58 C 4 

,4845 

-35,2335 

, 0263 

28,2 

m.ce 

,6274 

63,05 

,4852 

-30,0960 

, 0270 

28,4 

105.49 

,6745 

54,51 

,4860 

-25,9935 

, 0277 

28,6 

U)0 , 63 

, 7 ? ] 9 

47,52 

, 4867 

•22,6353 

, 0285 

28,8 

96,39 

,7694 

41,0-0 

,4876 

•19,8865 

,0293 

29.0 

92,64 

.8170 

37,01 

33,00 

,4885 

•17,5663 

,0301 

29,2 

89.33 

,6648 

,4895 

•15,6600 

,0310 

29,4 

86,37 

.9127 

29,58 

,49Q6 

-14,0216 

,0319 

29,6 

83,71 

.5611 

26,64 

,4916 

•12,6046 

,032H 

. 29.3 

61,31 

1,0096 

24,10 

, 4027 

-11,3652 

, 0338 

30.0 

' 79,14 

1,0*83 

21,99 

, 4939 

•10,3<59 

, 0348 

30,2 

77,17 

1.1C71 

19,97 

,4952 

-9,4037 

, 0359 

3C.4 

75.38 

1.1561 

18,29 

,4966 

-8,5958 

, 0370 

30.6 

73.73 

1,2057 

16,78 

, 4980 

- 7 , 8 7 0 0 

,0382 

30.8 

72,22 

1.2*55 

15,44 

,4994 

-7,2276 

, 0394 

31,0 

70,83 

1,3054 

14,25 

,P010 

-6,6590 

, 0407 

31.2 

69,55 

1,3569 

13,10 

,7026 

•6,1441 

, 0420 

31.4 

68,37 

1,4065 

12,22 

,5043 

•5,6040 

, 0434  - 

31.6 

67.28 

1,4574 

11,36 

,5061 

-5,2693 

, 0449 

31. 8 

66.26 

1 , 6 C 8 9 

10,57 

,5079 

■ 4, 8915 

, 0465 

32.0 

65.32 

1 , 5604 

9,86 

,5098 

•4,5511 

, 0481 

32,2 

64,44 

1.6332 

9,19 

,7110 

•4,2310 

, 0499 

32.4 

63,6? 

1,6656 

8,60 

,7130 

-3,9490 

,0517 

32.6 

62.86 

1,7166 

8,06 

,7159 

•I  «5  1 6 8 6 1 

, 053ft 

32.8 

62.15 

1.7719 

7,56 

,7182 

-3,4471 

, 0556 

33.0 

61,48 

1,6256 

7,09 

,7207 

•3,2261 

, 0578 

33.2 

60,85 

1,8005 

6,66 

,7228 

-3,0194 

,0601 

33,4 

60.27 

1.9354 

6,27 

,7254 

-2,8315 

, 0625 

33.6 

59,72 

1,9907 

5,91 

,7280 

•2,6585 

,0651 

33.  r. 

59,21 

2,0466 

5,57 

,730  7 

•2,4970 

, 0670 

34.0 

58,7? 

2,1036 

5,25 

,7334 

•2,3435 

,0707 

34.2 

58,27 

2,l605 

4,96 

,7364 

•2,2056 

, 0730 

34,4 

57,84 

2,2167 

4,68 

,7393 

-2,0727 

,0772 

34,6 

57,44 

2.2770 

4,42 

,7425 

•1,9521 

, 0008 

34,8 

57,06 

2,3365 

4,10 

,7457 

•1,8369 

.0847 

35.0 

56.70 

2,3963 

3,96 

,7491 

-1,7300 

,0088 

35.2 

56,36 

2,4570 

3,75 

,7526 

•1,6305 

,0V33 

35.4 

56 , 05 

2,5166 

3,55 

,7562 

-1,5363 

,0981 

35.6 

55,75 

2.5H09 

3,36 

,5600 

•1,4482 

,1034 

35,8 

55.47 

2.6438 

3,19 

,7640 

•1,3664 

,1090 

36,0 

55,20 

7,7080 

3,02 

,5680 

-1,2877 

,1153 

f 
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I\  5 52 


I 


% 

l 


I 

I 

l 


I 

I 

V 

I 

r 

i 


at  1 Q 

total 

ERHQR 

■jTfcR 

blZL 

. VAR 
TRR0R 

vak 

STEP 

covan 

MTTF 

36,'?. 

*4,95 

2.7726 

2,67 

.5723 

•1,2156 

,1221 

.56.4 

*4.72 

2.0387 

2,72 

,5767 

• 1,1460 

,1296 

46.6 

*4 ,49 

2 ,9(162 

2,59 

,5811 

"1 1 0791 

,1380 

36.8 

*4.28 

2.9742 

2,45 

,5858 

•1,0176 

,1472 

,1575 

,1689 

37.0 

54  , C9 

3,0433 

2,32 

,5908 

-,959e 

37.? 

53,90 

3,1136 

2,20 

,5960 

* , 9 0 bl 

37.4 

53,7? 

3,1*53 

2,09 

,e>0U 

-.8528 

,1320 

,1969 

37.6 

*3,56 

3,2585 

1,98 

,6068 

■»,  8031 

37,8 

53,40 

3,3326 

1,88 

. 6126 

-.7571 

,*J  38 

38.0 

53,26 

3,4087 

1,79 

,6185 

• , 7123 

,2337 

38,2 

53,12 

3 , 4 0 b 5 

1,70 

,6249 

- , 67i5 

,2564 

38,4 

52,99 

3,5448 

1,61 

,6314 

• 1 6 3 1 3 

, 2842 

38.6 

52,66 

3,64b3 

1,52 

,6382 

•,5941 

,3172 

38,6 

52.75 

3,7274 

1,45 

1,37 

,6454 

-,5592 

35  7 4 

39,0 

52,64 

3,6118 

,6529 

- 1 5256 

,4oe7 

39.2 

52,54 

3 , 89bl 

1,30 

,6607 

-,493e 

, 4751 

39,4 

52,44 

3.9R66 

1,23 

,6688 

• , 463b 

,5655 

39,6 

52,35 

4,0772 

1,17 

, 6774 

-,4353 

,6931 

39,6 

52,27 

4,1701 

1,11 

,6864 

-,  4087 

,8889 

4o,  e 

52,19 

4,2655 

1,05 

,6958 

-,3836 

1,2285 

40.2 

‘ 52.12 

4,3639 

,99 

.,7056  _ 

-,3594 

1,9/81 

40.4 

52. C5 

4 ,4647 

,94 

.7160 

-.3372 

4,7644 

Column  1 is  the  ratio  E( i-1 

Column  2 is  the  estimate  for  the  total  hrror  content 

Column  3 is  the  normed  estimate  for  step  size:  in  order  to  determine  the 
actual  estimate  for  the  step  oize,  the  entry  in  this  column  should  be  divided 
by  the  total  observation  time  T. 

Column  V is  the  approximate  standard  deviation  of  the  estimate  of  the  total 
error  content. 

Column  5 is  the  normed  standard  deviation  of  the  estimate  of  the  step  size: 
in  order  to  obtain  the  actual  standard  deviation  the  entry  in  this  column 
should  be  divided  by  the  total  time  T. 

Column  6 is  the  normed  covariance  between  II  and  ♦ : in  order  to  obtain  the 

actual  estimated  covariance  the  entry  should  be  divided  by  T. 

Column  7 is  the  normed  MTTF  and  in  order  to  obtain  the  actual  value  the 
entry  should  be  multiplied  by  T. 
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i\  s 53 


HATIP 

total 

I'-KHO” 

STFP 

size 

VAH 

FHPOH 

VAR 

STfcP 

OOVAH 

hT  TF 

26.2 

11?6.12 

.0*53 

12289,67 

,4759* 

5848,4652 

,0193 

* ’ 

26,4 

611.31 

.C906 

3c  7j ,63 

,4760- 

3461,6196 

,0198 

26.6 

416,47 

,1359 

1364,42 

, 4761 

•649,1327 

,0202 

26.8 

319,16 

,1"13 

767,19 

, 4763 

-364,9527 

, 020  7 

S*/ 

27.0 

?60t7fl 

.2267 

49(J,3l 

,4765 

-233 , 1 3 1 f? 

,0212 

27,2 

2?1 ,95 

,2721 

340,1* 

, 4768 

-101,6733 

,0217 

27.4 

194.26 

.3176 

249,59 

, 4771 

-110,5853 

, 0223 

W 

27.6 

173.53 

.3632 

l9  0 , 8 1 

,4775 

-90,6149 

, 0228 

27,8 

157,43 

,4  086 

ir>o,40 

,4779 

-71.4J61 

,0234 

28.o 

1*4,60 

,4546 

121,66 

, 4764 

• 5 7 , 7 0 3 9 

, 0240 

28.2 

134 ,12 

, 5 OC  4 

100,32 

,4769 

-47,5435 

, 0246 

28,4 

125.4? 

.5463 

84, 10 

, *795 

-39,8262 

,0253 

26,6 

no,  r,6 

.5923 

71,48 

, 4301 

•33,8230 

, 025V 

28,6 

lll.oC 

,6365 

6i,45 

,48ob 

•29,0452 

, 0266 

2 9.o 

106.39 

,65  48 

53,37 

,4*15 

-25,2037 

, 0273 

29.2 

101. 6S 

,7112 

46,77 

,4323 

-22,0631 

, 0281 

29.4 

97.53 

, 7 779 

*1,26 

,4031 

-l9 , 44  Cl 

, 0289 

29,fc 

93.87 

.8247 

36,67 

, 4340 

-17,2572 

, 0297 

29,6 

90.61 

,67i6 

32,79 

,4850 

-15,4067 

, 03Q5 

. ' 

3O.0 

87,68 

.9186 

29,46 

,4859 

-13,6249 

,0314 

30.2 

• «5, C6 

.9661 

26,61 

, 4870 

-12,4663 

,0323 

30.4 

82.69 

1.0136 

24,14 

,4882 

-11,2941 

,0332 

30.6 

80.54 

1 .C612 

21,99 

,4094 

• 10 ,27l« 

, 0342 

30.8 

76,57 

1.1094 

20,00 

,4906 

*9,3649 

,0352 

• 

3l  ,0 

76.71 

1,1578 

10,40 

.4918 

-8 ,563* 

, 0363 

31.2 

75.15 

1,2060 

16,93 

,4933 

-7,6676 

,0374 

31.4 

73.63 

1.2550 

15,60 

14,*3 

,4947 

*7,2349 

, 0386 

31.6 

72,25 

1,3039 

,4962 

-6 , 67  66 

, 0398 

_/ 

31.8 

70.95 

1,3536 

3 3,35 

,4977 

*6,1635 

,0411 

32.0 

6 9.76 

1,4030 

12,*1 

,4994 

•5,7156 

, 0425 

32.2 

66,66 

1.4530 

31,5* 

,5011 

•5,3043 

,0439 

32.4 

67,65 

1.5(J34 

3.0,75 

,5029 

-4,9306 

, 045<t 

32.6 

66,70 

1 ,5544 

10,03 

,5046 

*4 ,5860 

,04/0 

32.« 

65,fc? 

1.6053 

9,38 

,5067 

-4,2796 

, 0486 

33.0 

64,99 

1,6869 

6,78 

,5066 

-3,9945 

, 0503 

33,2 

64.22 

1,7066 

6,23 

,5107 

-3,7332 

,0522 

33.4 

63,49 

1.7613 

7,72 

,5128 

-3,4921 

, 0541 

33.6 

62.62 

1,8140 

7,26 

,>351 

-3,2733 

,0562 

33.8 

62,1« 

1 ,8673 

6,63 

,5174 

-3,0691 

,0583 

34 . 0 

61.59 

1.9211 

6,43 

.5198 

-2,8799  " 

*,0606 

-/ 

34.2 

01.C3 

1.9752 

6,06 

,5223 

-2, 7060 

,0630 

34.4 

6 ii , 5 0 

2,0305 

5,71 

,5?48 

■2,5400 

, 0057 

34.6 

60. Cl 

2,0*50 

5,40 

,5275 

*2,3897 

,uee4 

34.8 

59.55 

2,1*14 

5,10 

,5304 

-2,25j5 

,0713 

35.0 

59,11 

2,1982 

4,82 

,5332 

-2,118* 

,0744 

35.2 

58,70 

2.2556 

4 , 56 

,5361 

-1,9941 

, 0 778 

35.4 

56.31 

2.3129 

4,32 

,5394 

*1,0825 

,0813 

35,6 

57,95 

? , 37  j a 

4,09 

,5425 

-1 ,7731 

,005  2 

35,8 

57.60 

2.43o9 

3,87 

,5459 

•1,6731 

,0094 

* 

36.0 

57.28 

2, 49o6 

1,67 

,5494 

-1,5792 

,093d 

36.2 

56,97 

2 , 5 5 1 9 

3,4ft 

,5529 

-l,48dl 

, 0987 
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RATIO 

total 

STfcf* 

VAR 

VAR 

CQVAR 

M t t e; 

* ' 

ERROR 

SI/E 

ERROR 

ST£P 

i ' j 

36,4 

5)6.68 

2,6130 

3,30 

,5567 

•1,4059 

,1039 

36.6 

56.41 

2,67f?9 

3,13 

,5605 

•1,3252 

,109/ 

36.  H 

56.15 

2,7191 

2,97 

,3645 

-*1|25U 

,1159 

37.0 

5>5. 9j. 

2,8030 

2,82 

,5668 

•1,1622 

,1227 

37.? 

35 ,68 

2,8685 

2.68 

,5730 

•1,1151 

,1302 

37.4 

55,46 

2,9.144 

2,55 

,5776 

•1,Q535 

,1384 

37.6 

55. 25 

3.0020 

2,42 

,5822 

•,9931 

,1477 

37. 8 

55.36 

3,0703 

2,30 

,5870 

-,9375 

,1579 

3fl . o 

54.88 

3.J199 

2,10 

,5921 

• , 8844 

,1695 

38.2 

54.71 

3.210  2 

2,07 

,5974 

-,8354 

,1822 

38,4 

54.55 

3.2^22 

1,97 

,6029 

1,76*2 

,1969 

38.6 

54.39 

3,3557 

1,37 

, 6o65 

**,  7 4fc9 

,2137 

38.8 

54.?5 

3.4104 

1,78 

,6145 

" , 7 0 0 9 

,2332 

>> 

39,0 

54,11 

3,5066 

1.69 

,6206 

" , 66  o2 

,2559 

39.2 

53,99 

3,5847 

1,60 

, 6?7  0 

",6213 

,2632 

39,4 

53.67 

3.6639 

1,52 

,0337 

•, 5856 

,3154 

w 

39,6 

53,75 

3,7452 

1,44 

,6407 

- ,55i0 

,3554 

39,8 

53.64 

3,0264 

1,37 

,6480 

-,5182 

,4058 

40.0 

53.54 

3,9131 

1,30 

,6557 

-,4880 

,4655 

40.2 

53.45 

4,0001 

1,23 

,6636 

-,4588 

,5560 

4 0 , 4 

53,36 

4,0893 

1,17 

,6720 

*• , 4 3 1 3 

,6780  . 

l 

•>0.6 

53.28 

4 , ] 8 O’ 

1,11 

,6807 

-,4049 

,8648 

40.8 

53,20 

4,?7«a 

1,05 

,6899 

- , 38  1)3 

1,1^06 

41. 0 

53,12 

4 « 3 ? 1 3 

1,00 

,6995 

-,3570 

1,8366 

41.2 

52,  C5 

4 . 4 7c 7 

,94 

, 7095 

-.3349 

4 , U 6 7 4 

Column  1 4s  the  ratio  I(l-l)Xj/IX1 

Column  2 Is  the  estimate  for  the  total  &rror  content 

Column  3 is  the  normed  estimate  for  step  size:  in  order  to  determine  the 
actual  estimate  for  the  step  size,  the  entry  in  this  column  should  be  divided 
by  the  total  observation  time  T. 


Column  It  is  the  approximate  standard  deviation  of  the  estimate  of  the  total 
error  content. 

Column  5 is  the  normed  standard  deviation  of  the  estimate  of  the  step  size: 
In  order  to  obtain  the  actual  standard  deviation  the  entry  in  this  column 
should  be  divided  by  the  total  time  T. 

Column  6 is  the  normed  covariance  between  II  and  ♦:  in  order  to  obtain  the 

actual  estimated  covariance  the  entry  should  be  divided  by  7. 

Column  7 is  the  normed  MTTF  and  in  order  to  obtain  the  actual  value  the 
entry  should  be  multiplied  by  T. 
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N 


t?  4 


/ 


RATIO 

total  » 
Ffc’RUR 

STtP 

SUE 

ERROR 

VaH 

bTfcP 

COVAR 

HTTP 

27.0 

5l2.7i 

,1112 

2059,30 

,4716 

■970,6839 

,0196 

27,2 

374.07 

, 1 557 

1050,08 

, 4 7 1 6 

-494,8811 

, 0201 

27., 1 

297.13 

,2002 

634,83 

,4720 

*299, 1215. _ 

. ,0405 

27.  6 

248,21 

.2443 

424,50 

, 4722 

-199,9413 

,0210 

27.  H 

234.40 

,209  4 

303,62 

, 4725 

•142,9609 

,0213 

28. 0 

1*9 ,65 

,3341 

227,72 

,47?8 

-107,1728 

,0221 

28.2 

l7  0 ! 74 

,3780 

176,97 

141,45 

,4732 

•83,2333 

,0226 

29.4 

155.97 

.4736 

,4736 

,66,4939 

, 0232 

28.  A 

143.85 

,4586 

115,54 

,4741 

-54,2742 

,0*3* 

20.8 

133,96 

,5135 

96,14 

,4746 

-45,1323 

,0244 

29.0 

125.66 

,5507 

"1,1* 

, 4752 

-36,0634 

, 0250 

29,2 

116.62 

, 6039 

69,39 

,4758 

•32,5165 

, 0255 

29.4 

112.56 

,6492 

59,99 

52,34 

,4765 

•28,0900 

, 0263 

29.6 

107.33 

,6947 

,4772 

-24,4006 

, 027  0 

29. R 

102,75 

, 7403 

-46,04 

,4780 

-21,5124 

,02/7 

30.C 

96.70 

,7460 

40,79 

, 4788 

-19,0360 

,0285 

>*0.2 

95.10 

,8321 

36,35 

,4796 

-16,9432 

, 0292 

30.4 

9l.90 

,6781 

32,60 

,4806 

-15,1752 

, 0501 

30,6 

89,02 

,9243 

29,39 

,4816 

- 1 3 , 66 12 

, 0309 

30.8 

66.43 

,9708 

26,60 

, 4827 

-12,3464 

,0418 

31.  C 

• 04,07 

1,0176 

24,17 

,4837 

-11,1996 

, 0427 

31.2 

01.93 

1 , 06*5 

22,05 

,4849 

-JO, 2037 

, 0536 

31,4 

79,9  « 

1,1116 

20,19 

,4861 

-9,3249 

, 0546 

31.6 

78.20 

1.1580 

16,54 

,4874 

;»8 , 5527 

, U4S 7 

31.8 

76.55 

1.2067 

57,07 

, 4886 

-7,8545 

, 0467 

32.0 

75.05 

1,2544 

15,76 

, 4901 

-7,2423 

, 0479 

32.2 

73,65 

1,3023 

14,58 

,4915 

-6,6eso 

, 0491 

32.4 

72,37 

1.3510 

13,54 

,4931 

*6,1936 

, 0404 

32,6 

71.17 

1,4000 

12,57 

,4946 

•5,7389 

,0416 

32,6 

. 70, C6 

1,4491 

11,71 

,4962 

•5,3314 

, 0430 

33.0 

69.04 

1 ,4965 
1,5465 

10,92 

, 4979 

*4,9620 

, 0444 

3 3.2 

68,07 

10,20 

,4996 

-4,6222 

, 0459 

33,4 

67.19 

1,5961 

9,56 

,5017 

-4,3211 

, 0474 

33,6 

66.35 

1,6490 

8,95 

,5034 

-4,0330 

, 0491 

33,8 

65.57 

1,6996 

8,40 

,5055 

•3,7777 

, 0503 

34,0 

64,64 

1,7510 

7,89 

,5076 

•3,5384 

,0527 

34,2 

64.15 

1,8027 

7,43 

,5098 

•3,3179 

,0546 

34,4 

63,51 

1,8551 

6,99 

,5H9 

-3,1123 

, 0567 

34.6 

62,91 

1,9075 

6,59 

,5143 

•2,9258 

, 0588 

34.8 

62.34 

1,9606 

6,22 

,5167 

•2,7510 

,0611 

35.0 

61.  bi 

2,0143 

5,67 

,5192 

-2,5880 

,0656 

35.2 

61,31 

2.C664 

5,55 

,5218 

-2,4371 

, 0662 

35.4 

60.83 

2,1233 

5,24 

,5245 

•2,2949 

,0669 

35.6 

60,30 

2,1788 

4,96 

,5272 

-2,1613 

,0/19 

35,8 

59,97 

2.2343 

4,70 

,5302 

• 2 1 0 4 Q 7 

, 0750 

36.0 

59.57 

2,2914 

4,45 

,5330 

-1,9220 

, 0784 

36.2 

59.20 

2,3481 

4,22 

,5362 

-1,8163 

,0619 

36,4 

58,84 

2,4062 

4,00 

,5193 

•1,7130 

,0856 

36.6 

56,51 

2,4644 

,79 

,5428 

•1,6193 

,0899 

36.8 

56,20 

2,5239 

.5,6  0 

,5461 

-1,5286 

,0944 

37.f, 

57,90 

2,5838 

3,42 

,5497 

-1,4443 

, 0994 

1/8 


N 


e 


54 


RATIO 

total 

error 

STEP 
5 1 2 E 

VAR 

ERROR 

VAR 

STEP 

cqvar 

MTTF 

37,2 

57.62 

2.6450 

3,24 

,5533 

*1,3632 

,1046 

37.4 

57,35 

2,7065 

3,08 

,55/2 

•1 , 28119 

,1102 

37,6 

57,10 

2,7490 

2,93 

,5fti2 

-1,2160 

,1164 

37,8 

56.66 

2.6325 

2,78 

, 5653 

*1,1507  ~ 

, 1.23  3 

38.0 

56.64 

z.fl^c 

2,64 

,5696 

-1,0872 

,130b 

38.2 

56,43 

2,9623 

2,51 

,5740 

*1,0276 

,1390 

30,4 

56.23 

3.0264 

2,39 

,5787 

-,97i9 

,1460 

38,6 

56.04 

3.C963 

2,27 

,5834 

-,9170 

,1563 

33.0 

55,66 

3,1649 

2,16 

,5064 

-,8662 

,1097 

39.0 

55.69 

3.2345 

2,06 

,5936 

- , 8l86 

,1624 

39.2 

55.53 

3,3059 

1,95 

,5989 

-,7720 

,19  7 2 

39.4 

55.39 

3 , & 7 b o 

1,96 

,t>045 

- , 7g  S 6 

,2136 

39.6 

55.24 

3.4521 

1.77 

,6103 

-,6876 

,2331 

39, a 

55.11 

3 • 5?73 

1,68 

,6163 

- , 6486 

,2550 

*0.0 

54,98 

3,6039 

1,60 

,0227 

•{6120 

,2620 

40.2 

54,87 

3,6822 

1,52 

,0293 

-.5770 

,3139 

40.4 

54,75 

3,7623 

1,44 

,0361 

-,5437 

,3529 

40  ,C 

54.65 

3,8441 

1.37 

,6,133 

-,5121 

,4017 

40.8 

54.55 

3 ,9?79 

1,30 

,6507 

- ,4620 

,4646 

4l  .0 

54,45 

4.0137 

1,23 

,6565 

-,4534 

,54b  6 

4 1 , ? 

• 54,37 

4.1015 

1,1* 

,0666 

-,426b 

,6664 

41.4 

54,28 

4,1913 

1,11 

,6752 

-.4014 

,B«05 

41.6 

54.21 

4,283? 

1,05 

,0841 

-,3774 

1 ,1333 

41. n 

54,13 

4,3706 

1,00 

,093b 

-,354b 

1,7216 

42.0 

54,06 

4,4760 

,95 

, 7033 

-,3332 

3,4762 

Column  1 la  the  rstio  E(l-l)Xi/EX1 

Column  2 Is  the  estimate  for  the  total  ^rror  content 

Column  3 is  the  normed  estimate  for  step  site:  in  order  to  determine  the 
actual  estimate  for  the  step  site,  the  entry  in  this  column  should  be  divided 
by  the  total  observation  time  T. 

Column  I*  is  the  approximate  standard  deviation  of  the  estimate  of  the  total 
error  content. 

Column  5 is  the  normed  standard  deviation  of  the  estimate  of  the  step  size: 
in  order  to  obtain  the  actual  standard  deviation  the  entry  in  this  column 
Should  be  divided  by  the  total  time  T. 

Column  6 1s  the  normed  covariance  between  II  and  4:  in  order  to  obtain  the 

actual  estimated  covariance  the  entry  should  be  divided  by  T. 

Column  7 is  the  normed  IfTTF  and  in  order  to  obtain  the  actual  value  the 
entry  should  be  multiplied  by  T. 
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RATIO 

total 

LKRO« 

r.rzr; 

van 

trkoh 

VAK 

STfcP 

COVAP 

WTTF 

27.? 

12^7.24 

, 0436 

13486,44 

,4672- 

6300 

, 7309 

,0186 

27.4 

657.37 

.0*73 

337g,6i 

149?, 22 

,4673- 

1574 

,6860 

,01*u 

27.6 

447,49 

.1310 

,4674 

-699 

, 2688 

, 0 i $ 5 

27.8 

342,65 

.1747 

841,62 

,4675 

-392 

,9991 

,0199 

28.0 

279,81 

,2184 

538 , 1 8 

, 4678 

•251 

,2322 

, 0204 

28,;> 

237,95 

. 2622 

373,2? 

,4680 

•174 

,1811 

, 0208 

28.4 

2C6.12 

• 0 6 0 

273,91 

, 4683 

-127 

, 7665 

,0213 

28.6 

135,77 

,3499 

209,40 

,<686 

,4690 

• 97 

,6248 

,0219 

28.9 

163,45 

,3935 

165,25 

.77 

, 0084 

, 0224 

29,0 

154,59 

,4379 

133,55 

,4694 

-62 

,1936 

,0229 

29.2 

143.31 

,482u 

110.20 

,4699 

• 51 

,2895 

, 0235 

29,4 

133.92 

,5762 

92,38 

,4704 

-42 

,9604 

, 0241 

29.6 

126,00 

.5705 

73,51 

,4710 

-36 

,4805 

, 0247 

29.8 

119.23 

,6150 

67,51 

,4716 

-31 

,3399 

, 0253 

*30.0 

113.39 

,6595 

53,64 

,4722 

.27 

,1972 

, 0260 

3o,2 

1J8.30 

. 7342 

51,39 

, 4730 

-23 

,8094 

, 0266 

30  .A 

103.83 

.7190 

’ 45,38 

.4737 

-21 

,001$ 

, 0273 

30.6 

99.87 

.7940 

40,33 

,4745 

-18 

,6445 

, 0261 

30.8 

96.35 

.8390 

36,08 

,4754 

.16 

,6600 

,0266 

31 .0 

93.20 

.3843 

32,44 

,4764 

-14 

,9601 

,0296 

31.2 

90,35 

,9?99 

29,29 

,4773 

-13 

f 49  Q6  _ 

, 0304 

31.4 

87,78 

,97*5 

26,59 

,4783 

-12 

,2256 

,0313 

3l.6 

85.45 

1 .0?l4 

24,21 

,4794 

-11 

,1143 

,0322 

3l.8 

53,33 

1.0674 

22,13 

. 4805 

-to 

,1453 

, 0331 

32.0 

81,38 

1,1138 

20,29 

,4816 

.9 

,2638 

, 0340 

32.2 

79.61 

1.1602 

18,67 

,4829 

,5304 

,0350 

32.4 

77,97 

1,2070 

1,233$ 

17,22 

,4842 

.4856 

•7 

,8523 

, 0361 

32.6 

76,46 

15,93 

-7 

,2503 

, 0372 

32,8 

75,07 

1 , 3C1 2 

14,76 

, 4870 

.6 

, 7043 

, 0383 

33.0 

73,79 

1.3487 

13,71 

,4885 

.6 

,2149 

,0395 

33.2 

72.57 

1,3970 

12,74 

,4899 

-5 

, 7633 

, 0407 

33.4 

71.47 

1,4447 

11,99 

,4916 

-5 

,3690 

,0-20 

33,6 

7 i) , 4 2 

1,4937 

11,10 

, 4931 

.4 

,9948 

, 0434 

3J.8 

69,47 

1,5420 

10,39 

,4950 

.4 

,6687 

, 0446 

34.0 

68,56 

1.5917 

9,72 

, 4967 

.4 

,3554 

, 0463 

34.2 

67,72 

1,6407 

9,13 

,4987 

it  4 

,0814 

, 0479 

34.4 

66,93 

1.6909 

6,57 

,5005 

,8193 

,'0456 

34.6 

66,19 

1.74H 

8,06 

,5026 

,5821 

,0513 

34,8 

65,50 

1.79i? 

7,59 

, ,5047 

*3 

,3636 

,0532 

35,0 

64  ,64 

1,6432 

7,15 

,5067 

.3 

,1567 

,0551 

35.? 

64.23 

1,8947 

6,74 

,5090 

w2 

,9691 

, 0572 

35.4 

63,65 

1,9468 

6,37 

,5113 

-2 

,7933 

,0594 

35,6 

63.11 

1,9990 

6,02 

,5138 

.2 

,6334 

, O81  7 

35.8 

62.60 

2,0525 

5,69 

.5162 

r2 

,4782 

,0641 

36 . o 

62.12 

2.1057 

5,39 

,5188 

s2 

,3393 

,056  7 

36.2 

61.66 

2,1400 

5,10 

,5215 

.2 

,2056 

,0695 

36 .4 

61.23 

2,2147 

4 , B 3 

,5242 

.2 

,0811 

,0724 

<36  • 6 

60.63 

2.2698 

4,58 

,5271 

-1 

,9659 

, 0756 

36.6 

60.45 

2, 3257 

4,35 

,5300 

-1 

,6567 

,0789 

37.0 

6 0 » C 9 

2.38?4 

4,12 

,5331 

.1 

,7536 

,0625 

37.2 

59,74 

2,4397 

3,9\ 

,5362 

• 1 

,6566 

,0664 
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RATIO 

total 

error 

STEP 

SIZE 

VAR 

ERROR 

VAR 

STEP 

cqvar 

MTTF 

37.4 

39.4? 

2.4976 

3,72 

,5395 

*1,5663 

, 0906 

37. A 

39,12 

2.5659 

3,53 

,5430 

*1,4824 

,0950 

37.6 

38,83 

2,6153 

3,36 

,5465 

*1,4016 

,oyva 

38.0 

*>8. 56 

2.6755 

3,19 

,?501 

*1,3254 

,1051 

38.2 

38,30 

2.7363 

3,04 

,5540 

*1,2543 

,1107 

38.4 

38.06 

2.7978 

2,09 

,»580 

•1,1676 

,1109 

38,6 

37.82 

2.8111 

2,74 

,5619 

-1,1214 

,1238 

38,0 

57.61 

2,9242 

2,61 

,5663 

*1,00  24 

,1311 

39.0 

57,4  0-— 

2,9891 

2,49 

,5706 

*1,0043 

,1394 

39.2 

57.21 

3.0546 

2,37 

,5751 

-,9498 

,1484 

39.4 

57,0? 

3.1216 

2,25 

,3790 

-,8973 

,1567 

39,6 

56,64 

3,1894 

2,14 

,3847 

-,  8483 

,1700 

39.8 

56,68 

3,2579 

2,04 

,5899 

-,  8029 

,1025 

«0 .0 

56.53 

3,3261 

1,94 

,5951 

-.7587 

,1969 

AO  .2 

56,30 

3.3997 

1,85 

,900* 

- ,7J67 

. ..  ,*139 

«0.4 

56,24 

3,4725 

1,76 

,6063 

-,6769 

,2325 

AO  .8 

56,11 

3,6470 

1,67 

.9122 

-,6385 

,2549 

A 0 . 8 

55.90 

3.6227 

1,59 

,9164 

-,6026 

,*611 

A 1 , 0 

55.86' 

3,7001 

1.51 

,6248 

-,5683 

,312  7 

Al.? 

55,76 

3,7767 

1,44 

,6316 

-,5367 

,3504 

A 1 . 4 

55.65 

3.6595 

1,37 

1,30 

,6386 

-.5056 

,3964. 

41.6 

55,55 

3,9420 

,6459 

-.  4765 

,4594 

Al.fi 

55,46 

4,0264 

1,23 

1,17 

,6535 

-,  4489 

,5400 

A2.0 

65,37 

4.1129 

,0615 

-,4227 

,6525 

42. 2 

55,29 

4.2016 

1,11 

,6898 

-,3977 

,019  7 

42.4 

55.21 

4.2925 

1,06 

,6785 

-,3742 

1.0V2V 

42 , A 

55,14 

4,3858 

1,00 

, 6876 

-,35g0 

1,6220 

A2.fi 

55,07 

4,4817 

,95 

,6972 

-,33  09 

3,0916 

26,0159 

43,0 

55,01 

Column  1 is  the 
Column  2 is  the 

4,5603  ,90  ,7072 

ratio  E(i-l)Xj/IX1 

estimate  for  the  total  irror  content 

-,3112 

Column  3 is  the 

normed  estimate 

for  step  size: 

in  order 

to  determine 

the 

actual  estimate  for  the  step  size,  the  entry  in  this  column  should  be 
by  the  total  observation  time  T. 

divided 

Column  U is  the  approximate  standard  deviation 
error  content. 

of  the  estimate  of  the 

total 

Column  5 Is  the 

normed  standard 

deviation  of  the  estimate 

of  the  step 

size: 

in  order  to  obtain  the  actual  standard  deviation  the  entry  in  this  column 
should  be  divided  by  the  total  time  T. 

Column  6 is  the  normed  covariance  between  II  and  in  order  to  obtain  the 
actual  estimated  covariance  the  entry  should  be  divided  by  T. 

Column  T is  the  normed  MTTF  and  in  order  to  obtain  the  actual  value  the 
entry  should  be  multiplied  by  T. 
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RATIO 

TOTAL 

ERROR 

STfP 

SUL 

VAR 

ERROR 

VA« 

STEP 

C0VA«  _ 

28.o 

55q  , 43 

.1072 

2256,19 

,4631’ 

1044,4417 

,0189 

28.2 

401.27 

.1*01 

1150,25 

,4632 

.532,34q2 

,0193 

28.4 

316,47 

,1931 

695,16 

,4634 

-321,6234 

,9197 

28.6 

265. 6fl 

.2360 

465,03 

,4^36 

•215,1026 

,0202 

28.fl 

229,51 

.2790 

332,64 

,4639 

•153,8161 

,0207 

29.o 

202.88 

,3221 

249,54 

,4642 

■1 J 5 ,3440 

,0211 

29.2 

1«2.53 

,3652 

193,95 

,4645 

•89,5959 

,0216 

29.4 

166.51 

,4084 

154,98 

,4649 

•71,5529 

,0222 

29.6 

153.58 

,45l7 

,4751 

126,64 

105,34 

,4053 

*58,4305 

,0227 

29.fi 

• 142,91 

,4658 

•48,5666 

, 0232 

30.0 

133.99 

,5385 

88,97 

76,11 

,4663 

•40,9937 

, 0236 

30.2 

126.42 

,5820 

,4669 

•35,0420 

, 0244 

30.4 

119,90 

,6257 

65,79 

57,42 

r>0,52 

, 4675 

•30,2665 

, 0250 

30.6 

114,25 

,6695 

,4682 

•26,3686 

, U256 

30.8 

109,30 

,7134 

,4689 

*23,1924 

,0263 

31.0 

104,94 

, 7574 

44,77 

,4697 

•20,5333 

, 0270 

31.2 

101.06 

.6017 

39,91 

,4704 

• 1.8,2623 

, 027  / 

31,4 

97,60 

,8460 

35,80 

,4713 

•16,3791 

, 0264 

31,6 

94,49 

,6904 

32,28 

,4722 

•14,7500 

, 0292 

3l,B 

91.69 

, 9350 

29,23 

,4732 

•13,3403 

,0300 

32,0 

' 39,15 

,9799 

26,58 

,4742 

•12,11 12 

,0308 

32.2 

86,84 

1,0249 

24,26 

,4752 

■1 1 , 0382 

,0316 

32.4 

84,72 

1 .0704 

22,29 

, 4762 

•10,0851 

, 0325 

32.6 

82,79 

1,1158 

20,40 

,4774 

•9,2531 

,0335 

32.8 

81.01 

1,1615 

1.8,79 

, 4786 

.8,5078 

, 0344 

33.0 

79,39 

1,2073 

17,37 

,4799 

•7,8501 

, 0354 

33,2 

77,87 

1,2537 

16,07 

,4812 

*7,2484 

, 0365 

33,4 

76,47 

1.3001 

14,91 

,4825 

•6,7142 

, 0376 

33.6 

75.19 

1.3465 

13,88 

, 4fi4 1 

• 6,2373. 

, 0387 

33.0 

73,99 

1,3935 

12,93 

,4855 

*5,7984 

, 0399 

34.0 

72,86 

1,4409 

12,07 

,4871 

-5,3989 

,0412 

34,2 

71,83 

1,4084 

11,29 

,4887 

-5,0379 

, 0425 

34,4 

70.84 

1,5367 

10,56 

,4902 

-4,6988 

, 0438 

34.6 

69.94 

1.5047 

9.91 

,4921 

*4,3996 

, 0453 

34.8 

69. C9 

1,6331 

9,30 

,4939 

-4,1227 

, 0 4 6 H 

35.0 

68,29 

1,6023 

8,74 

6,22 

,4957 

•3,6623 

, 0484 

35.? 

67,54 

1.73l« 

,4976 

-3,6230 

, 0501 

35.4 

66,64 

1,7813 

7,75 

,4997 

*3,4070 

,0518 

35.6 

66,18 

1,8315 

7,31 

,5017 

-3,2024 

, 0537 

35,6 

65,55 

1,8821 

6,90 

,5039  ' 

•3,0136 

,0556 

36.0 

64.97 

1.9329 

6,53 

,5062 

-2,8406 

, 0577 

36.2 

64.42 

1.9845 

6,17 

,5085 

-2.6761 

, 0599 

36.4 

63.90 

2,0364 

5,84 

,5109 

*2,5241 

, 0622 

36,6 

63.41 

2.0890 

5,53 

,5133 

•2, 3810 

, 0646 

36.fi 

62,94 

2,1422 

5,24 

,5158 

-2,2470 

, 0672 

37.o 

62.50 

2,1957 

4,97 

,5185 

•2,1223" 

' , 0700 

37.2 

62,09 

2.2495 

4,71 

,5213 

•2,0071 

, 0729 

37.4 

61.70 

2,3341 

4,47 

4,25 

,5241 

-1,8960 

, 0761 

37,6 

61.34 

2.3593 

,5271 

-1,7950 

, 0 7 V 4 

37.6 

60.99 

2.4152 

4,04 

,5102 

-1,6983 

,0*30 

38,0 

60,64 

2 , 4 7 1 5 

3,84 

,5334 

-1,608? 

, 086V 
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RATIO 

TOT  Al 

STLP 

VAR 

CQVAR 

MT7P 

f.  H R 0 *' 

M7fc 

ERROR 

STEP 

38.?? 

60,34 

2,5289 

3,65 

,5366 

-1,5212 

,0910 

38.4 

60.G5 

2,5868 

3,47 

,5400 

-1,4401 

, 0955 

38.6 

59,77 

2,6455 

3,30 

,5435 

-1,3633 

,1003 

38,8 

59, 5C 

2,7049 

3,14 

,5471 

el,29lC 

,1055 

39.0 

59, 2^ 

2.7654 

2,99 

,5508 

*1,2215 

,1112 

39,2 

59,01 

2,6267 

2,85 

,5546 

-1,1558 

, 1 1 7 5 

39.4 

56.79 

? , 8887 

2,71 

,5586 

-1,0941 

,1243 

39,6 

56,57 

2.55J4 

?,58 

,5628 

el,  0364 

,1316 

39,8 

58,37 

3. 0150 

2,46 

,5672 

-.9821 

,1397 

«0.0 

56 , 1H 

2.0799 

2,34 

,5717 

-,9295 

,i4eb 

*0.2 

58.00 

2.1462 

2, 23 

,5763 

-,e7tj7 

,1590 

80.4 

57.63 

3.2131 

2,12 

,5811. 

-.8315 

,1/02 

40.6 

57,67 

3 . ?8j  2 

2,02 

,5861 

-,7e68 

,1628 

40.6 

57,51 

• 3,35c5 

1,93 

,5913 

-,7442 

,1V?1 

41,0 

57,37 

3,42C« 

1,64  _ 

,5968 

-,  7043 

,2133 

41.2 

57,23 

3,4926 

1,75 

,60Z4 

-,665V 

,2320 

41.4 

57,10 

3.5660 

1,66 

,6082 

-,6290 

,2540 

41.6 

56,98 

3,6409 

1,58 

,6142 

-,5938 

,2M00 

41.8 

56,87 

3.7169 

1,51 

,6206 

- 1 56 12 

,3105 

42.0 

56.76 

3,7948 

1,44 

,6272 

-,5296 

,3«ei 

42,? 

56.65 

3,8742 

1,37 

,6341. 

-,4999 

, 3943 

42,4 

56,56 

3,9556 

1,30 

,6412 

- , 47 1 4 

, 4530 

42.6 

56.47 

4,0387 

1,24 

,6487 

-,  4445 

,5317 

42.8 

56,38 

4,1239 

1,17 

,0564 

-,4190 

,6391 

43.0 

56,30 

4,2114 

1,12 

,6645 

-,3944 

, 7905 

43,2 

56,22 

4,3006 

1,06 

,6731 

-,3716 

1,0507 

43,4 

56,15 

4,3926 

1,01 

,?«19 

-,3496 

1,5312 

43,6 

56.08 

4,4868 

,96 

,0912 

-.3292 

2,7*56 

43.8 

56,02 

4,5837 

,7010 

-,3096 

12,7656 

Column  1 is  the 

ratio  r(i-l)XI/EX1 

Column  2 is  the 

estimate  for 

the  total  irror  content 

Column  3 is  the 

normed  estimate  for  step  size: 

in  order 

to  determine 

the 

actual  estimate 

for  the  step 

size,  the  entry  in 

this  column  should  be 

divided 

by  the  total  observation  time  T. 

Column  I*  Is  the  approximate  standard  deviation  of  the  estimate  of  the  total 
error  content. 

Column  5 is  the  normed  standard  deviation  of  the  estimate  of  the  step  site: 
in  order  to  obtain  the  actual  standard  deviation  the  entry  in  this  column 
should  be  divided  by  the  total  time  T. 


Column  6 is  the  normed  covariance  between  !l  and  in  order  to  obtain  the 
actual  estimated  covariance  the  entry  should  be  divided  by  T. 

Column  7 is  the  normed  IfTTF  and  in  order  to  obtain  the  actual  value  the 
entry  should  be  multiplied  by  T. 
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RATIO 

Totai, 

PR&OR 

5TrP 

SUE- 

VaR 

ERROR 

vAR 

*TfcP 

CQVaR 

MTTK 

28.2 

1 3 '•  i , 4 7 

» 0 4 21 

14743,30 

,4589- 

6765,4170 

,0179 

* 

28,4 

704,99 

1 C 8 42 

3685,01 

,4590" 

l69o,B573 

,0183 

28.  A 

479,57 

.1264 

1636,88 

,4591 

-75Q  , 939C 

. .0167 

28.8 

366.97 

,1686 

920,22 

,4592 

•422,0807 

,0191 

29. n 

299.44 

.2106 

588,37 

, 4594 

*269 ,7834 

,0196 

29.2 

254,51 

.2830 

408,26 

, 4596 

.187,1490 

, 0200 

29,4 

222.45 

,2953 

299,60 

,4599 

"137,2634 

, 0205 

** 

29.6 

198,46 

,3176 

229,13 

,4602 

-104,9587 

, 0209 

29  ,£ 

179.61 

.3*00 

180,73 

,*♦606 

r82,74l4 

,0214 

30.0 

164.92 

,4  225 

146,10 

, 4609 

r66 , 64 33 

,U219 

w 

^0. 2 

1^2,78 

,4650 

120,54 

,4614 

•55,1179 

,0225 

30.4 

142,68 

.5077 

101,05 

1 4 6 18 

r-46,1696 

,0230 

3q  .A 

1 3 4 , 1 9 

,55()3 

85,96 

.4624 

.39,2515 

, 0235 

w 

30.8 

126,91 

.5931 

73,93 

,4630 

.33,7331 

, 0241 

31. 0 

120,62 

,6360 

64,23 

,4636 

.29,2765 

,0^7 

31.2 

115,13 

, 6791 

56,28 

,4642 

• 25 , 63  08 

, 0253 

W 

31.4 

110.32 

.7223 

49,71 

,4649 

.22,6147 

,0260 

31.6 

106,06 

,7655 

44,21 

,4657 

r ?0 , 0 9 1 9 

,0266 

% 

3l.fi 

1C2.26 

. 8069 

39,54 

, 4664 

.17,9504 

, 0273 

32.0 

98,65 

,8526 

35,55 

,4672 

.18,1159 

, 0280 

3 2,2 

95,79 

,8964 

32,12 

,4681 

-14,5456 

_ .OS*?  - 

32.4 

93,02 

, 9 4 0 3 

29,16 

,4690 

.13,1641 

,0295 

32.6 

9Q  .50 

, 9 P 4 4 

26,56 

,4700 

-31,9927 

,0303  ’ 

32.0 

38,2? 

1,0985 

24,30 

,4711 

•10,9592 

,0311 

33,0 

r'6.1? 

1,0731 

22,29 

,4721 

.10,0349 

, 0320 

33.2 

84,20 

1,1177 

20,51 

,4733 

•9,2213 

, 0329 

33.4 

82.43 

J. , 1625 

18,93 

,4745 

•,8,4956 

,0338 

33.6 

80.79 

1,2079 

17,50 

,4756 

•7,8373 

,0348  - 

33.8 

79,29 

1,2533 

16,23 

, 4770 

•7,2573 

, 0358 

34.0 

77. eP 

1,2990 

15,07 

,4782 

.6,7246 

, 0469 

, 0380 

34.2 

76,59 

1.3448 

14,04 

, 479ft 

.6 , 25  07 

—✓ 

34 . 4 

75.39 

1. J9c6 

3 3,10 

,4B12 

•5,8250 

, 0391 

34,6 

74,26 

1,4371 

12,24 

,4826 

.5,4292 

, 0403 

34,6 

73.21 

1,4342 

11,45 

,4041 

.5,0641 

,0416 

35. f 

72,23 

1.531U 

10,74 

,4858 

•4,7391 

,0429 

35.2 

71,31 

1,5784 

30,07 

.4075 

.4,4365 

, 0443 

35,4 

7 0 . 45 

3.6263 

9,47 

,4891 

.4,1567 

, 0457 

* 

35.6 

69,64 

1.6744 

8,91 

,4909 

.3,9003 

,U472 

35.0 

68,89 

1,7227 

l,77i4 

8,39 

7,91 

,4928 
, 4948 

.3,6651 

,0488 
,0505' ' 

36.0 

68,10 

.3,4474 

36.? 

67,51 

3 .6205 

7,47 

,4968 

•3,2454 

,0523 

36.4 

66 , 80 

1 ,8698 

7,06 

,4990 

.3,0592 

•2,88i4 

,0541 

36.6 

66,29 

1,9201 

6,67 

,5011 

, 0561 

-V 

36,8 

65,73 

1.97o4 

6,32 

,5034 

•2 , 7l 99 

,0581 

37.0 

65,20 

2,r?l3 

5,98 

,5057 

.2,5672 

,0*03 

37.2 

64.70 

2.0728 

5,67 

,5080 

•2,4237 

,0627 

J 

37,4 

64,23 

2,1243 

5,38 

,5104 

.2,2894 

,0651 

37,6 

63.78 

2.1772 

5,10 

,5130 

.2,1645 

, 06  77 

37.8 

63,36 

2.2395 

4,35 

,5157 

-2,049? 

, 0705 

38.0 

62,97 

2 , ?P3l 

4,61 

,5.185 

-1,9400 

, 0734 

38.2 

62,58 

2,3376 

4,37 

,5?12 

-1,8336 

, O/60 
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RATIO 

Total 

step 

VAR 

*/A« 

cqvah 

. _ httf _ _ 

— 

fkhor 

a I Zb 

FRHOR 

STEP 

38.4 

62.23 

2,3920 

4,16 

,5242 

•1,7371 

,0799 

J 

38.6 

61.89 

2,4476 

3,95 

,5271 

ml, 6437 

,0636 

38.8 

61.57 

2,5035 

3,76 

,5303 

•1,5571 

,0674 

39.0 

61.27 

2.5596 

3,58 

,5336 

-1,4772 

,0915 

39.2 

60.98 

2.6173 

3,41 

,5369 

•1,3983 

,0960 

39,4 

60,71 

2,6754 

3,2? 

,5403 

•1,3248 

,1009 

39,6 

60.45 

2.7341 

3,09 

,5439 

ml, 2558 

,1061 

39.8 

6C.20 

2.7935 

2,95 

,5477 

sl.1907 

,1117 

A 0 ♦ 0 

59,97 

2 , 8**36 

2,81 

,>516 

•1,1296 

_ 

^0.2 

59.75 

2.9153 

2,66 

,5555 

•1,0692 

,1246 

40.4 

59,54 

2.9776 

2,55 

,5595 

•1,0129 

,1321 

40.6 

59.35 

3,0403 

2,43 

,5639 

-,9610 

,1601 

40.8 

59.16 

3,1045 

2,32 

,568  3 

-,9100 

,1491 

w 

41.0 

58,98 

3,1698 

2,21 

,5728 

- ,86l5 

,1592 

41.2 

58,81 

3,2360 

2.U 

,5776 

-,8158 

,17Q3. 

41.4 

58,6.6 

3 , 3 0 3 0 

2,01 

,5826 

-,7732 

,1027 

41,6 

56.51 

3.37i5 

1,92 

,5877 

-.7319 

,1969 

4l.B 

58,36 

3,44l4 

1,»3 

,5929 

-,6521 

,2132 

42.0 

58,23 

3,5124 

1.74 

,5985 

-,6547 

,2318 

* 

42,2 

58,10 

3.5847 

1,66 

,6042 

,-.6194 

,2534 

42.4 

' 57,98 

3.6585 

1.58 

,6101 

-,5854 

‘ ,2789 

42.6 

57,67 

3,7337 

1,50 

,6163 

-,5532 

,3092 

42.6 

57. 7r> 

3,8103 

1,43 

,6228 

-.5230 

,5M56 

43.0 

57,66 

3,8368 

1,36 

,6296 

-.4939 

,39U 

43.2 

57,56 

3,9688 

1,30 

,6366 

-,4664 

,4484 

w 

43.4 

57,47 

4,0508 

1,24 

,6439 

- ,4402 

,5237 

43.6 

57.39 

4,1348 

lilfl 

,6515 

.',4149  _ 

,6277 

43.8 

57.31 

4,2206 

1,12 

,6595 

•* , 3 9 1 5 

, 7 761  "i_ 

0 

44.0 

57,23 

4,5088 

1,06 

,6677 

.,3680 

1,0146 

44.2 

57.16 

4.3990 

1,01 

,6764 

-,3477 

1,4440 

44,4 

57.09 

4.4919 

,96 

,6854 

-,3273 

2,4851 

44.6 

57.03 

4,5871 

,91 

,6949 

-,3082 

8,3549 

Column  1 is  the  ratio  Ili-lJXj/IXj 

• 

5 

e4 

CM 

§ 

r~i 

s 

estimate  for  the 

total  irror 

content 

Column  3 1*  the  nomed  estimate  for  step  size:  in  order  to  determine  the 
actual  estimate  for  the  step  size,  the  entry  in  this  column  should  be  divided 
by  the  total  observation  time  T. 

Column  *»  is  the  approximate  standard  deviation  of  the  estimate  of  the  total 
error  content. 


Column  3 is  the  normed  standard  deviation  of  the  estimate  of  the  step  site: 
in  order  to  obtain  the  actual  standard  deviation  the  entry  in  this  column 
should  be  divided  by  the  total  time  T. 

Column  6 is  the  normed  covariance  betveen  If  and  4:  in  order  to  obtain  the 

actual  estimated  covariance  the  entry  should  be  divided  by  T. 

Column  7 is  the  normed  MTTF  and  in  order  to  obtain  the  actual  value  the 
entry  should  be  multiplied  by  T. 
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R/TJO 

total 

error 

STEP 

SUL 

VaR 

ERROR 

VAR 

bTfcP 

COVAR 

29.0 

569,3* 

• 1035 

2462,10 

,4550- 

1119.7692 

,0182 

29.2 

429.42 

.1449 

1255,93 

,4552 

-57i,i6Al 

,0106 

29,4 

340.61 

.1064 

759,22 

,4553 

-345,1095 

„ ,Ol9o 

29.6 

204.1* 

.2279 

*07,71 

,4555 

-23O,70U 

,0194 

29.8 

245.13 

.2694 

363,25 

,4550 

-165,0629 

,0150 

.0 

216,52 

.3110 

272,43 

,456Q 

•123,7327 

, U2Q3 

>*0  • 2 

1«4.72 

,352* 

211,06 

,4564 

-96,1856 

,0207 

«Jo . 4 

1^7 ,53 

,39^2 

369,35 

,4567 

• 76 ,8498 

,0212 

Jo  .ft 

163.6? 

,4360 

130,34 

,4571 

-62,7323 

...  ,0217 

JO  .8 

1*2.10 

, 4778 

115,12 

,4575 

-52,1689 

,0222 

3l  .0 

142.61 

.5197 

97,27 

,4580 

•44,0586 

,0227 

'U,? 

134,46 

.5617 

03,20 

,4505 

-37,6533 

,0233 

•*1  .4 

127,45 

,6039 

71.9? 

,4591 

•32,5189 

,0238 

Jl.6 

121.37 

.6461 

62,77 

,4597 

•28,3593 

,0244 

31.0 

116, 06 

,68f>3 

55,26 

,4604 

•24,9442 

,0250 

32.0 

111,36 

.7300 

48,96 

,4610 

•22,0782 

, 0256 

32.2 

107.20 

,7733 

43,69 

,4610 

•19,6790 

,0263 

32.4 

103,48 

,0160 

39,19 

,4625 

,4633 

•17,6345 

,0265 

32.6 

100,12 

,0590 

35,3? 

-I*,e7l2 

,0276 

32.0 

97,10 

,9020 

32,00 

,4642 

-14,3612 

,0264 

33.0 

' 94,37' 

,9451 

29,11 

,4651 

-13,0489 

,0291 

J3.2 

91.83 

,9584 

' 26,57 

,4661 

•11.8558’ 

,0299 

33.4 

09.60 

1,0321 

24,34 

,4670 

-10,8777 

, 0307 

33.6 

37,52 

1.0757 

22,37 

,4681 

-9.9C31 

,0315 

33.0 

35,61 

1.1198 

20,62 

,4692 

-9,1887 

,0324 

34.0 

83,84 

1,1630 

19,05 

,4703 

•8,4724 

,0333 

34.2 

32,21 

1,2062 

17,64 

16,37 

,471b 

,4727 

-7,8353 

,0342 

,0352 

34.4 

80.69 

1.2529 

• 7 ,2563 

34,6 

79.30 

1.2974 

15,25 

,4741 

-6,7462 

,0362 

34.0 

78. OC 

1.3426 

14,21 

,4755 

-6,2746 

,0372 

35.0 

76,73 

1 ,348J 

13,26 

, 4760 

•5,8431 

, 0384 

35.2 

75,65 

1,4338 

12,40 

,4782 

•5,4Sl6 

, 0395 

35,4 

74,60 

1,4795 

11,63 

,479H 

-5,1005 

, 0407 
,0420 

35.6 

73,61 

1.5259 

10,98 

,4813 

.4,7716 

35.0 

72.69 

1.5722 

10,25 

,4830 

•4,4745 

,0433 

36,0 

71,83 

1,6169 

9,64 

,4048 

•4,2006 

,0447 

36.2 

7l,01 

1,6664 

9,07 

,4864 

ij3,94i6 

,0«61 

36.4 

70.24 

1,7137 

6,56 

,4883 

•3,7065 

, 047  / 

36.6 

69.52 

1 , 7 ft  1 7 

8,07 

,4901 

,4921 

-3,4690 

, 0493 

36. P 

68,85 

1,8097 

7,63 

•3,2895' 

',0509 

37.0 

68,21 

1,0586 

7,21 

,4941 

•3,0982 

,0527 

37,2 

67,60 

1.9076 

6,03 

,4961 

,4983 

•2,9233 

,0546 

37.4 

67,04 

1,9570 

6,47 

•2,7610 

,0565 

47.6 

ft6 ,50 

2,0069 

6,13 

,5005 

•2,6077 

,0586 

37.M 

66,00 

2,0570 

5,02 

,*029 

-2,4673 

,0608 

38.0 

65,52 

2,1079 

5,52 

,5053 

•2,3326 

,0631 

36.2 

65 , C6 

2,1*92 

5,24 

,5073 

•2,2075 

,0656 

36.4 

64.63 

2.2112 

4,98 

,*102 

,*129 

•2,0885 

,0662 

36. A 

64.23 

2.2632 

4,73 

•1 ,9793 

,0/10 

38.6 

63.64 

2,3165 

4,50 

,*1*6 

-1,8729 

,0/39 

39.0 

63,46 

2 ,3696 

4,28 

« *10* 

•1,7766 

,07/1 
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RATIO 

TOTAL 

r:KP0p 

5 Tf-P 
SUE 

VAR 

FRHQR 

VAR 

STEP 

C0VA* 

HJTF 

39,2 

63.13 

2,4236 

4,08 

.?2l3 

el ,6834 

,0804 

49.4 

62. 60 

2,4782 

3,83 

,3244 

•1,5970 

,0840 

49.6 

62,49 

2,5336 

3 1 70 

,3275 

•1.3141 

,Q«7? 

49.8 

62.19 

2.3499 

3,52 

.3306 

el, 4347 

,0920 

^0.0 

61.92 

2,6461 

3,36 

,3340 

•1,3624 

,0964 

40.2 

61,65 

2.7Q4C 

3,20 

,3374 

•1.2905 

,1013 

4 0 . 4 

61.40 

2.7616 

3,05 

,3410 

•1.2259 

,1064 

40.6 

61.16 

2, 8208 

2,91 

,3446 

•1.1620 

,1121 

40.8 

60,93 

2,8830 

2,78 

,3484 

•1.1022 

4l.fl 

60.72 

2,9411 

2,65 

,3524 

•1,0457 

, 1250 

4 1 , ? 

*0.52 

3,0325 

2,53 

,3564 

-.991? 

,1323 

4J.4 

6(5,32 

3,0649 

2,41 

,36Q6 

• , 94  08 

,140  4 

41.6 

60.14 

3 , i ?H4 

2.36 

,3650 

-,8916 

.1494 

41.8 

59,96 

3,193c 

2,19 

,3694 

• ,8446 

,1594 

42.0 

59,80 

3,2581 

2 , Q9 

,3742 

..."  1 6 Q 1 3 

,1/03 

42.2 

59.65 

3,3245 

2,00 

,3790 

•,7595 

,1627 

42.4 

.59,50 

3,3923 

1,90 

,3840 

•.7192 

,1969 

42.6 

59,36 

3,4411 

1,8? 

,3893 

• , 68 13 

,2128 

42.8 

59,23 

3,5310 

1,73 

,3947 

-,6454 

,2310 

43.0 

59.10 

3,6027 

1,65 

,6003 

-.6104 

,2525 

43.2 

' 58,98 

3.6754 

1.57 

.6062  _ 

-.5777 

,2773 

43.4 

58,87 

3,7494 

1,50 

.6123 

• , 5469 

,3069 

43.6 

58.76 

3,8254 

1,43 

,6186 

-.5167 

,3431 

43.8 

58,66 

3, 9026 

1.36 

,6252 

• , 4887 

,3671 

44. C 

58,57 

3,9816 

1,^0 

,6321 

•.,4616 

,4431 

44.2 

58.48 

4.0625 

1.24 

,6392 

•.4359 

,3160 

44.4 

58,39 

4,1452 

i.i* 

,6466 

“ 1 4 1 1 4. 

44.6 

58.31 

4,2297 

1.12 

,6544 

- , 3864 

, 7366 

44.8 

58.24 

4,3164 

1.07 

.6626 

• , 3666 

,9766 

45.0 

58,17 

4.4055 

1.02 

,6710 

-,3454 

1,3716 

45.2 

58,10 

4,4967 

.97 

,6798 

-.3256 

2,2636 

45.4 

58.03 

4,5904 

,9? 

,6890 

•,3068 

6,2316 

Column  1 la  tha  ratio  Kl-DXj/IXj 

Column  2 la  tha  estimate  for  the  total  hrror  content 

Column  3 la  the  normed  estimate  for  step  site:  In  order  to  determine  the 
actual  estimate  for  the  step  size,  the  entry  In  this  column  should  be  divided 
by  the  total  observation  time  7. 

Column  b la  tha  approximate  standard  deviation  of  the  estimate  of  the  total 
error  content. 

Column  5 la  tha  normed  standard  deviation  of  tha  estimate  of  the  step  site: 

In  order  to  obtain  tha  actual  standard  deviation  the  entry  in  this  column 
should  be  divided  by  the  total  time  T. 

Column  6 is  tha  normed  covariance  between  II  and  4:  In  order  to  obtain  the 

actual  estimated  covariance  the  entry  should  be  divided  by  T. 

Column  T Is  the  normed  HTTP  and  In  order  to  obtain  the  actual  value  the 
entry  should  be  multiplied  by  T. 
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RATIO 

total 

error 

step 

SIZE 

VAR 

ERROR 

VA« 

STfcR 

CQVA« 

< 

29.2 

1479.26 

.qao7 

1,6075 , 64 

,45ll« 

7251,2774 

* ' 

29.4 

754.27 

.0*16 

4016,17 

,4511- 

1011.1695 

29.6 

512,82 

.1221 

1784,73 

,5512 

•804,8155 

29,8 

492.11 

.1020 

1003,05 

,4513 

•452,1975 

30 .0 

319, 80 

.2036 

64i,64 

,85.15 

-289,2209 

30.2 

271,62 

,2444 

445,13 

,5517 

•200,3770 

3p . 4 

237,25 

.2852 

326,66 

,4520 

-147,1360 

30.6 

211.53 

.3261 

249,81 

,4523 

-112,4769 

30.0 

1*1.56 

,3*7j 

197,16 

,4526 

-88,7375 

3l . 0 

175,60 

• 4 G®  0 

159,42 

,4530 

-71,7114 

31.2 

162.58 

, 4491 

131,53 

,4534 

-59,1294 

3l.4 

lbi  ,75 

.4902 

110.29 

,4538 

-49,5472 

31.6 

142.61 

.5315 

93,77 

,4542 

-42,0932 

31.8 

144.60 

.5728 

80,67 

,4547 

-36,ie5l 

32.0 

128,06 

,6142 

7 0 * 1 1 

,4553 

-31,4238 

32.2 

122.10 

,6557 

63,47 

,4559 

•27,5291 

W 

32.4 

117,  G3 

,6973 

54,30 

,4566 

-24,2950 

32.6 

112,43 

,7390 

48,29 

,4572 

-21,5845 

32,8 

138,34 

,7310 

43,13 

, 4579 

-19,2001 

f 

33.0 

1J4.70 

,0229 

33,86 

,4567 

• 17 , 3356 

33,2 

' 101, 4C 

.O051 

55,12 

,4595 

-15,6453 

33.4 

96,42 

.9074 

31,88 

,4603 

-14,1034 

w» 

33.6 

95.71 

,9499 

29,05 

,4612 

-12,9085 

33.0 

93,25 

,99?5 

26,58 

,4622 

-11,7951 

34.0 

90.96 

1,0354 

24,39 

,4631 

-10,8059 

34.2 

88,91 

1,0784 

22,44 

,4642 

-9,9297 

34,4 

87,01 

1,3215 

20,72 

,4653 

•9,1551 

34.6 

85,25 

1,3648 

19, 18 

,«664 

•0,4397 

34.8 

83,62 

1,2064 

17,79 

,4676 

-7,0334 

| 

35.0 

82,11 

1,2523 

16,53 

,4688 

-7 ,2660 

35.2 

80.71 

1,2963 

15,40 

.4701 

-6,7561 

35.4 

79,4!) 

1.3408 

14,37 

,4713 

-6,2090 

35,6 

78,19 

J ,3352 

13,44 

,4727 

-3,8717 

35.8 

77.06 

1,4301 

12,58 

,4741 

-5,4043 

36,0 

75.99 

J .4754 

11,79 

,4755 

-5,1209 

36.2 

75.0C 

1,5208 

11,07 

,4770 

•4,8034 

J 

36.4 

74.07 

1,5661 

10,42 

,4788 

-4,5138 

46.6 

73.20 

1,6122 

9,81 

,4803 

•4,2370 

36.8 

72,37 

1 , e 5 ti  5 

9,24 

,4820 

•3,9841 

37. t 

71.60 

1.7052 

8,72 

,4838 

• 3,7490  ' 

47.2 

73.87 

1.7522 

8,24 

,4856 

•3,5316 

07.4 

70, l* 

1,7994 

7,79 

,4875 

•3,3308 

47.6 

69.54 

1,6472 

7,37 

,4894 

•3,1422 

37,8 

68,93 

1,6954 

6,98 

,4914 

-2,9662 

38,0 

68,35 

1,9439 

6,62 

,4933 

-2,8030 

46.2 

67,60 

1,9929 

6,27 

,4956 

•2,6491 

J 

38.4 

67.29 

2.0420 

5,96 

,4979 

•2,5002 

38.6 

66.80 

2.0919 

5,66 

,3002 

•2,3731 

38.  e 

66,34 

2.1421 

5,38 

,3026 

-2,2478 

39. C 

65,90 

2.J930 

5,11 

,3030 

-2,1265 

39,2 

65.49 

2,2440 

4,06 

,3076 

•2,0193 
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HTU 


,0173 

,0177 

_,01fiQ 

,0104 
,0180 
,0152 
,0197 
,0201 
,0296 
,0210 
,0216 
,0220 
,0226 
,0230 
,0236 
, 0241 
,0247 
,0263 
,0259 
, 0266 
, 0273 
,0200 
,0267 
,0294 
,0302 
,0310 
,0313 
,0327 
, 0336 
, 0345 
, 0355 
,0366 
,0376 
“,036  V 
,0399 
,0411 
,0424 
,0437 
_ , 0451 
,0465 
,0461 
, 0497 
,0614 
,0531 
,0550 
,0570 
,0590 
,0613 
,0636 
,0661 
,0666' 


N 


S 59 


RATIO 

total 

ERROR 

mp 

S I 7E 

VAR 

ERROR 

VAH 

t>TLP 

• C&VA* 

mttf 

39.4 

65.10 

2.2960 

4,63 

,5102 

ml , 91 29 

,0714 

39.4 

64,72 

2.3485 

4,40 

,?12« 

«1,8132 

, 0744 

39.8 

64,37 

2,4014 

4,20 

,5156 

"1,7202 

,07/6 

40.  C 

64,0* 

2,4545 

4,00 

,5186 

el.6341 

, 0009 

40.2 

63. 7j 

2.509? 

3,61 

,5214 

1-1,5480 

,0-845 

40.4 

63,42 

2.563? 

3,64 

,5247 

•1,4724 

,0883 

40.6 

63.13 

2,fcie7 

3,47 

,5?78 

•1,3971 

,0925 

40. 8 

62.66 

2.6749 

3,31 

,5311 

•1,3257 

,0969 

4l  , 0 

62,60 

2.73lfl 

3,15 

,5344 

•1,2582 

,m« 

41.2 

62.35 

2.7093 

3,01 

,5380 

•1,1948 

,1069 

41  • 4 

62.12 

2,8472 

2,87 

.5417 

•1,1355 

,1 U? 

41.6 

6l.9o 

2.9f)66 

2.74 

,5454 

•1.0771 

,ne/ 

4l.fi 

61.69 

2.9663 

2,62 

,5493 

•1,0230 

,1253 

42,0 

01,49 

3,0275 

2,50 

,5532 

-,9700 

,1327 

42.2 

61,30 

3,0068 

2,39 

,5574 

-,9215 

,1407 

42,4 

61,1? 

3.1515 

2,28 

.561? 

• , b?43 

,i496 

42.6 

6C.95 

3,2153 

2,10 

,5661 

-.8292 

,1895 

42,8 

60,76 

3,2796 

2 1 08 

,570« 

-,7872 

,1704 

43.0 

60,64 

3,3453 

1,98 

,5756 

- , 7468 

,1026 

43.2 

. 60.49 

3,4124 

1,89 

,5805 

•,7074 

,1967 

43,4 

60.35 

3.48Q4 

1,81 

,5856 

• , 67  00 



43,6 

60.2? 

3,5494 

1.73 

,5910 

-,6359 

,2304 

43.8 

60.10 

3,6700 

1,65 

,5965 

•,6022 

,2515 

44,0 

59,98 

3,6918 

3,7652 

1.57 

,6023 

-,5703 

,2700 

44,2 

59,67 

1,50 

,6082 

-,5396 

,3054 

44.4 

59,77 

3,6398 

1,43 

,6145 

-,5109 

,3403 

44,6 

59,67 

3,9161 

1,36 

,8210 

•,4835 

,3833 

44.8 

59,57 

3,9941 

1,30 

,0276 

•,4509 

,4380  * 

*5.0 

59,48 

4.0737 

1,24 

,0346 

- , 4320 

,5oe2 

45.? 

59,40 

4.1553 

1,18 

,6419 

-.4081 

,0034 

45.4 

59,32 

4,2386 

1,13 

,6495 

•,3855 

,7382 

45.0 

59.24 

4,3241 

1,07 

,0574 

•,3638 

,9*62 

45.6 

59,17 

4,4116 

1.02 

,0057 

-,3434 

1,3.1)46 

46,0 

59,11 

4,5014 

,97 

,0743 

-,3240 

2,0737  " 

46.2 

59,04 

*.5935 

,92 

,6833 

-,3056 

4,9350 

Column  1 Is  the  ratio  E( i-lJXj/EX^ 


Column  2 la  the  estimate  for  the  total  £rror  content 

Column  3 Is  the  normed  estimate  for  step  size:  In  order  to  determine  the 
actual  estimate  for  the  step  size,  the  entry  In  this  column  should  be  divided 
by  the  total  observation  time  T. 

Column  *»  is  the  approximate  standard  deviation  of  the  estimate  of  the  total 
error  content. 

Colusui  5 Is  the  normed  standard  deviation  of  the  estimate  of  the  step  site: 

In  order  to  obtain  the  actual  standard  deviation  the  entry  In  this  column 
should  be  divided  by  the  total  time  T. 

Column  6 Is  the  normed  covariance  between  II  and  4:  In  order  to  obtain  the 

actual  estimated  covariance  the  entry  should  be  divided  by  T. 

Column  7 Is  the  normed  MTTF  and  In  order  to  obtain  the  actual  value  the 
entry  should  be  multiplied  by  T. 
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N * 60 


RATIO 

total 

error 

STM1 

SfZF. 

VAR  . 
ERROR 

VaR 

STEP 

CGVaR 

mttp 

4 

41 

30.0 

629. 7i 

.1000 

2<>8p,47 

,4474- 

1198,6596 

,0175 

3o  .2 

456. 53 

, 14q1 

1 367  24 

, 4475 

.611,3529 

,0179 

30.4 

363.49 

• inoi 

026,68 

4477 

■369,5852 

,0103 

30.6 

3 fj  3 . 0 ? 

. 2 ? 0 3 

552,74 

,4478 

•247,0102 

,0107 

w 

30.0 

261.25 

,2*04 

395,48 

,4431 

•176,6999 

,0191 

31.0 

230,64 

,300? 

296,66 

,4483 

•t32,48«o 

,0155 

31.9 

2uV.2'> 

, 34  ()7 

230,72 

,4406 

•103,0024 

,Ul99 

* 

3l,4 

l88 ,8ft 

,3810 

184,38 

,4489 

•02,2666 

,0204 

31.6 

174.01 

.4213 

1*0,75 

,4493 

*67,2359 

,0200 

3l.8 

161,73 

.46i8 

125,41 

,4497 

*55,8923 

,0213 

* 

32.0 

151.45 

. y C23 

105,91 

.8501 

*47,1669 

,0210 

32.2 

142.74 

.5428 

90,65 

,4506 

*4  0 , 35  q5 

,0223 

32.4 

135.24 

,S»34 

78,40 

,45U 

*34,8731 

,0228 

32.6 

120.72 

,6242 

63,43 

,4516 

*30,4121 

,0233 

32.8 

123, CP 

,ft650 

6o,25 

,4523 

*26,7514 

, 0239 

33.0 

117.99 

, 7060 

53,40 

.4529 

*23,6879 

. 0244 

* 

33,2 

113.52 

, 7470 

47,65 

,4536 

*21,1104 

, 0250 

33.4 

109,52 

, 7flfl2 

42,75 

,4543 

*18,9277 

, 0256 

33.6 

105,92 

,8297 

38,54 

,4549 

*17,0396 

, 0262 

33.8 

1 j2 , 66 

,8711 

34,92 

,•4558 

*15,4250 

, 0269 

34,0 

99.73 

,9l?fi 

31,77 

,4566 

*14,0126 

, 0276 

34.? 

• 97.07 

,9644 

29,03 

,4575 

*12, 7856 

, 0283 

* 

34.4 

94.62 

.9963 

26,60 

,4384 

•11,7037 

, 0290 

34.8 

92, 3H 

1,0364 

24,45 

,4594 

*10,7439 

, 0257 

3 4,8 

9U.3i 

1,0800 

22,53 

,4601 

*9,0865 

,0305 

* 

35.0 

08.41 

1,1234 

20,02 

,4614 

*9,1207 

,0313 

3*>.2 

86,65 

1.1661 

19,29 

,4624 

*0,4357 

, 0322 

35.4 

85. Cl 

1.2090 

17,9? 

,4636 

• 7 1 8 2 00 

, 0330 

35.6 

03.5? 

1.2521 

16,67 

,4647 

*7,2657 

, 0340 

35.8 

82,13 

1,2952 

15,56 

,4661 

-6,7700 

, 0349 

36.0 

8 C , 8 1 

1.3390 

14,53 

,4673 

*6,3057 

, 0359 

36.2 

79.59 

1.3827 

13,60 

,4686 

*5,89i0 

,0369 

36.4 

76,45 

1,4269 

12,74 

, 4700 

•5,5009 

, 03eo 

36,6 

77.36 

1,4*13 

11,96 

,4714 

-5,1364 

,0391 

V 

• 36.* 

76.38 

1.5150 

11,24 

,4729 

>4,6402 

, 0403 

37.0 

75,45 

1,6606 

10,53 

,4744 

•4,5455 

,0415 

37.2 

74,57 

1,6057 

9,97 

,4761 

*4,2746 

,0428 

37.4 

73.73 

1,6814 

9,40 

,4776 

*4,0194 

,0441 

37.6 

72.96 

1,69o8 

8,09 

8,40 

,4795 

•3,7906 

. 0455 

37.8 

72.22 

1,7431 

,4812 

•3,5710 

, 0469 

3 

38.0 

71.5? 

1.7897 

7,94 

,4830 

*3,3692 

, 0465 

38,2 

70.87 

1 , £ 364 

7,53 

,4849 

■3,1833 

,0501 

38.4 

70.25 

1,6830 

7,13 

,4868 

•3,0063 

,0510 

V 

38.6 

69.6/ 

1.931G 

6,77 

,4809 

-2,0461 

,0535 

38,8 

69,11 

J ,9792 

6,42 

6,10 

• i’P9, 

•2,6914 

.0554 

• 

39.0 

68,59 

2,0279 

.^30 

*2,5463 

,0974 

39.2 

68,10 

2,0763 

5,00 

,4953 

*2,4145 

,0595 

39.4 

67,63 

2,1255 

5,51 

5,24 

,4976 

,5000 

*2,2068 

,0617 

39,6 

67.18 

2.1754 

•2,1694 

,0640 

39.8 

66,76 

2,2258 

4,99 

,5024 

*2,0565 

,0665 

40.0 

66.35 

2,2767 

4,75 

,5048 

• 1 ,9501 

,0691 
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K * 6f) 


1 

ratio 

TOTAL 

SUR 

VA* 

VA* 

COVA* 

HTTP  ..... 

fcfcRO" 

S I ? E 

ERROR 

STEP 

1 

40.? 

65.97 

2,3260 

4,53 

,6074 

ml, 8505 

,0719 

J 

40.4 

65.61 

2.3796 

4,32 

.5102 

ml , 7577 

,0749 

j 

4U  . 6 

65,27 

2.43?1 

4,11 

,5129 

*1,6683 

.:....  ,0780 

! 

40  .« 

64,95 

2.4847 

3,93 

,5J58 

-1,5859 

,0813 

4 1 , 0 

64,64 

p.ssei 

3,75 

.5188 

•1,5072 

,0849 

( 

4 1 '.  ? 

64,35 

2.5921 

3,68 

,5219 

•1,4323 

,0887 

41.4 

64.07 

2,6470 

3,41 

,5260 

*1 , 36  04 

, UV2  V 

41.6 

63.80 

2,7030 

3,26 

,5282 

• 1 , 29  00 

,UV?4 

4 1 , ft 

63.55 

£.7568 

3,11 

,5316 

•1,2279 

,1921 

42. C 

63.31 

2,8160 

2,97 

,6350 

*1,1658 

,1074 

I >— / 

42.2 

63.08 

2,6736 

2,84 

,5386 

•1,1079 

,1130 

42.4 

62,87 

2.9317 

2 .71 

,5424 

•1,1)536 

j 

42.6 

62.66 

2.99C9 

2,59 

,5462 

*1,0012 

,1257 

1 - 

42.8 

62.46 

3,0512 

2 , 4ft 

,5502 

* ,95  u® 

,1330 

43.0 

62,28 

3,1121 

2,37 

, 5543 

*,9033 

,1410 

i 

43.? 

62.10 

3,1740 

2,26 

,5565 

*,8581 

,1498 

i ^ 

43.4 

61.94 

3,2367 

2,16 

,5630 

-,8151 

,1595 

43.6 

61,78 

3,3010 

2,06 

,5674 

- . 7727 

,1706 

43.8 

61.63 

3 i 3 6 5 5 

1,97 

,5722 

*,7345 

,1825 

j 

44,0 

61 , 48 

3,4319 

1,80 

,5770 

* , 6962 

,1965 

»•! 

44.2 

61,35 

3.4988 

1,80 

,5821 

*,6610 

,211?-.- 

44.4 

61.22 

3,5673 

1,72 

.6874 

- , 6266 

,2299 

44.6 

61,10 

3.6371 

1,64 

.5928 

-,593ft 

,250  7 

1 

44.8 

60,98 

3,7077 

1,57 

,6986 

* ,5633 

, 2745 

45.0 

60.87 

3,7801 

1,50 

,6043 

*,£336 

,3  032 

f 

45.2 

60,77 

3,8540 

1,43 

,6104 

-,5051 

,3378 

j 

45,4 

60,67 

3,9?9? 

1,36 

,6168 

-,47e3 

,3798 

45.6 

60,56 

4,0062 

1,30 

,6233 

-,4525 

,4328  - 

> 

45.8 

< 60.49 

4, 0847 

1,24 

.6302 

-.4281 

,5008 

i 

46.0 

60,41 

4,1651 

1,18 

,6373 

*,4040 

,5920 

u 

46.? 

60,33 

4,2472 

1,13 

,6447 

• , 3826 

, 7204 

46,4' 

60.25 

4,3313 

1,08 

.6525 

- , 36i6 

,9137 

1] 

46,6 

60,1s 

4.4175 

1,02 

.,?606 

*,3415 

.....  1,2*25  ... 

1 

46.8 

60,1? 

4,5061 

,99 

,6689 

-.3222 

1,9230 

47,0 

60,05 

4,5966 

,93 

,6777 

•,3043 

4.UV70 

| . 

Column  1 is  the 

ratio  Ki-DXj/EXj 



Column  2 Is  the 

estimate  for  the  total  irror  content 

| 

Column  3 Is  the 

normed  estimate  for  step  size: 

in  order  to 

determine 

the 

1 

actual  estimate 

for  the  step  size. 

the  entry  In 

this  column 

should  be 

divided 

by  the  total  observation  tine  T. 

Column  I*  Is  the  approximate  standard  deviation  of  the  estimate  of  the  total 
error  content. 

Column  5 Is  the  normed  standard  deviation  of  the  estimate  of  the  step  sizes 
In  order  to  obtain  the  actual  standard  deviation  the  entry  In  this  column 
should  be  divided  by  the  total  time  T. 

Column  6 la  the  normed  covariance  between  II  and  4:  In  order  to  obtain  the 

actual  estimated  covariance  the  entry  should  be  divided  by  T. 

Column  7 la  the  normed  HTTP  and  In  order  to  obtain  the  actual  value  the 
entry  should  be  multiplied  by  T. 
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Appendix  III 

FORMULAS  FOR  THE  GEOMETRIC 
DE-EUTROPHICATION  PROCESS 


Summarized  here  are  formulas  for  this  process  which  can  be  evaluated  when 
the  two  parameters  D and  k are  found.  The  parameter  can  be  solved  by 
the  equation: 


zik1_1X 

zk*_1x7 


n+1 

2 


III-l 


With  this  value  of  k(k),  the  value  of  D can  be  determined  through  the 
equation: 


6 * — ^ 1 1 1-2 

k * " ‘ X1 

The  estimate  for  the  MTTF  at  the  end  of  test  is 


The  estimate  of  purification  percentage  is 


P2  * (1 -kn) 100 


III -4 


The  variance  and  covariances  are  given  by 


For 


Var  D * D2 

2(2n-l ) 
n(n+l) 

III -5 

Var  k - k2 

12 

1 1 1-6 

n(nz-l) 

A A 

Covar  (D,k) 

- -Dk  6 

III-7 

nTn+TT 

evaluation  D and  k would  be  used. 
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